Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Spoofing ASK?
2 keyplyr 1:54 am Jun 7, 2007
YahooSeeker/M1A1-R2D2
3 MaxM 5:09 am Jun 6, 2007
Busy id-search.org/bot.html
2 longen 7:55 pm Jun 1, 2007
Claims to be Ask
IP registered to MCI
7 volatilegx 12:21 am May 27, 2007
MySpace News bot
improper identification
3 MaxM 1:32 pm May 22, 2007
Is this really Yahoo's slurp?
2 botslist 12:56 am May 22, 2007
More on tide526.microsoft.com
30 helleborine 4:33 pm May 19, 2007
Secure Sites From Botnet Vulnerability Probes
15 incrediBILL 1:15 pm May 14, 2007
mqbot@cazoodle.com
4 SEOPTI 12:10 am May 9, 2007
Anyone know what VB Project is?
This user agent appears followed by normal browser
8 bouncybunny 6:09 am May 6, 2007
Major Intel.com Spidering Activity - Multiple IP's
3 Brett_Tabke 11:04 pm May 5, 2007
Project Honey Pot files $1B+ Lawsuit Against Spammers and Spambots
spam harvesters about to be harvested in court
24 incrediBILL 2:06 pm May 1, 2007
Open-I-Search Unveiled
Interview with the BotMaster
2 yodokame 4:48 pm Apr 29, 2007
Referer is Google with no search string
http://www.google.com/ - that's the whole URL
5 Umbra 8:06 pm Apr 24, 2007
how to stop people from spoofing google ips?
3 jake66 5:25 pm Apr 22, 2007
What to do with libwww-perl/5.79?
Netscape or NetScrape?
2 blend27 9:10 pm Apr 21, 2007
cgi bad-bot script
interesting ip
15 dolcevita 4:21 am Apr 19, 2007
Tips to detect what are bad bots in your bot trap
And what are humans clicking bot trap
21 silverbytes 2:02 pm Apr 18, 2007
New Yahoo bot.
Yahoo-Test/4.0
4 bobothecat 2:11 am Apr 18, 2007
Faking to be Googlebot
2 sami 2:57 am Apr 17, 2007
Banning Microsoft URL Control
Best method?
18 bouncybunny 10:13 am Apr 14, 2007
Jeeves
What they up to?
3 wilderness 1:53 am Apr 12, 2007
K-Meleon
13 wilderness 11:11 pm Apr 9, 2007
someone spoofing?
these are some wierd UAs
5 wkitty42 2:11 am Apr 9, 2007
Songbird/0.1
Botnet, Controlled?
4 blend27 10:44 pm Apr 8, 2007