Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Nessus::soap huh? |
2 | Bewenched | 3:59 am Sep 11, 2008 | ||||
| Java in User Agent Is it safe to block? |
12 | smallcompany | 1:22 pm Sep 8, 2008 | ||||
| Mozilla/5.0 (compatible; BMC/1.0 (Y!J-AGENT)) |
3 | GaryK | 3:50 am Sep 8, 2008 | ||||
| GoogleEarth |
3 | wilderness | 3:47 am Sep 8, 2008 | ||||
| DotBot |
6 | keyplyr | 11:49 pm Sep 4, 2008 | ||||
| MSIE 7 prefetch XP and Vista prefetch with MSIE 7 |
4 | dstiles | 9:33 pm Sep 3, 2008 | ||||
| msnbot crawling with massive binary strings in URIs appears to be some buffer overflow vulnerability |
3 | incrediBILL | 11:15 pm Aug 27, 2008 | ||||
| Google Toolbar as Spider What should be returned? |
2 | dstiles | 5:15 pm Aug 27, 2008 | ||||
| UAs with a space *before* a semi-colon New spider/somethingorother? |
6 | Pfui | 1:19 am Aug 27, 2008 | ||||
| libwww-perl/5.812 |
6 | wilderness | 3:05 am Aug 26, 2008 | ||||
| fdfdkll.html Google gone crazy? |
5 | phred | 12:39 pm Aug 25, 2008 | ||||
| AOL toolbar? What is ee://aol/http |
11 | dstiles | 8:51 pm Aug 21, 2008 | ||||
| Accelovation |
2 | Bewenched | 9:12 am Aug 20, 2008 | ||||
| AVG Stops Real-Time Scanning Webmasters Complain AVG Debilitating Traffic Analytics[2] ( 1 2 ) |
39 | Cyclob | 9:52 pm Aug 17, 2008 | ||||
| Unusual UA |
4 | wilderness | 9:51 pm Aug 17, 2008 | ||||
| Scout |
14 | wilderness | 3:10 pm Aug 17, 2008 | ||||
| YebolBot |
2 | wilderness | 4:47 pm Aug 16, 2008 | ||||
| spokespider looks like a business directory/networking bot |
3 | idiotgirl | 2:22 am Aug 14, 2008 | ||||
| User-Agent: Mozilla Invalid UA - is it valid? |
16 | dstiles | 10:44 pm Aug 12, 2008 | ||||
| UA - EmailSearch |
8 | phred | 7:37 am Aug 12, 2008 | ||||
| Name Intelligence spoofing Yahoo Slurp from a Google-esque IP address range |
6 | jdMorgan | 11:32 pm Aug 11, 2008 | ||||
| Lightspeed Systems sneaky creepy greedy crawler |
4 | idiotgirl | 9:31 am Aug 11, 2008 | ||||
| TMUFE and TMASE |
2 | keyplyr | 9:22 am Aug 11, 2008 | ||||
| Does Google use a FrontPage UA? |
3 | mayest | 12:42 am Aug 10, 2008 | ||||
| Hex String requested file |
8 | wilderness | 10:04 pm Aug 9, 2008 |