Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Isara/Isara-1.0
5 keyplyr 2:51 pm Oct 23, 2009
google.com -- spoof? spider? botnet zombie? employee?
10 Pfui 10:45 pm Oct 20, 2009
Comcast Launches Anti-Botnet Initiative "Constant Guard"
Infected Owners Will Be Warned
28 incrediBILL 3:05 am Oct 20, 2009
NeoDownloader
image ripper
2 dstiles 4:19 pm Oct 19, 2009
Mozilla/4.61 [en] (X11; U; ) - BrowseX (2.0.0 Windows)
2 smallcompany 5:57 am Oct 17, 2009
SurveyBot/2.3 (D o m a i n T o o l s)
Revisited. Republishing (c) Content. Re-Exposed.
3 Pfui 2:53 am Oct 16, 2009
Real-time checking IPs
scrapers are hitting me hard
2 SEOPTI 2:01 pm Oct 15, 2009
integrity/3.0
2 keyplyr 6:31 am Oct 13, 2009
Please welcome Ocean10000 as new Spiders co-Moderator
13 incrediBILL 5:03 pm Oct 9, 2009
MSR-ISRCCrawler repurposed
Now with analysis "for Microsoft's Search and Ads services"
7 caribguy 12:16 am Oct 9, 2009
msnbot/.search.msn.com uses Wget
5 Pfui 7:21 pm Oct 7, 2009
Yahoo!-AdCrawler
5 GaryK 6:16 pm Oct 7, 2009
Internetbot
3 GaryK 3:32 am Oct 7, 2009
Qseero v1.0.0
6 keyplyr 12:10 am Oct 7, 2009
What really is doing PC Media Center ?
5 schnee 1:29 pm Oct 6, 2009
TencentTraveler
6 GaryK 1:34 am Oct 6, 2009
S2Bot/1.0
5 keyplyr 12:46 am Oct 6, 2009
parchmenthill
13 Pfui 12:34 am Oct 6, 2009
Will the Real Googlebot-Mobile Please setup forward.
Googlebot-Mobile
3 Ocean10000 10:24 pm Oct 4, 2009
LinkExaminer/1.01 (Windows)
2 GaryK 10:07 pm Oct 4, 2009
Yahoo! SearchMonkey
3 wilderness 10:03 pm Oct 4, 2009
taptubot
9 Pfui 5:19 pm Oct 4, 2009
Micro trend is goofing my system
Micro trend is goofing my system
14 schnee 5:28 pm Oct 3, 2009
Outlook 2007 RSS User-Agent
2 Ocean10000 6:05 am Oct 1, 2009
Dot TK - spider
4 keyplyr 5:31 am Sep 30, 2009