Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
VizzitSpider
2 keyplyr 2:27 am Jan 19, 2016
List of Data Centre IP ranges for blocking purposes
8 Xpat 3:55 am Jan 17, 2016
SEOdiver
6 keyplyr 10:18 pm Jan 16, 2016
Svven-Summarizer
6 keyplyr 2:19 am Jan 16, 2016
wpif and imgsizer
9 lucy24 9:18 am Jan 14, 2016
EuripBot
3 keyplyr 8:52 am Jan 9, 2016
golabbot
2 keyplyr 7:13 pm Jan 6, 2016
vebidoobot
3 keyplyr 6:08 pm Jan 4, 2016
packets
4 wilderness 9:07 pm Jan 1, 2016
KomodiaBot
3 keyplyr 11:26 am Dec 29, 2015
Server Farms - November 2015
Tracking and Reporting Data Center IP Ranges[3] ( 1 2 3 )
80 Ocean10000 5:50 am Dec 29, 2015
infegy
4 keyplyr 5:22 am Dec 28, 2015
ltbot
2 keyplyr 10:17 pm Dec 26, 2015
SheerBoredom.Experimental.Robot
5 keyplyr 8:36 am Dec 25, 2015
wonderbot/JS
3 keyplyr 10:12 pm Dec 17, 2015
Microsoft Hong Kong (plainclothes)
5 keyplyr 4:19 am Dec 13, 2015
simplereach
3 keyplyr 9:21 pm Dec 12, 2015
Lipperhey-Kaus-Australis
6 keyplyr 9:36 pm Dec 10, 2015
VeriCiteCrawler
6 keyplyr 8:51 am Dec 10, 2015
scripted dot com
12 lucy24 10:32 pm Dec 8, 2015
CRIM Crawler
Centre de Recherche Informatique de Montreal
7 Pfui 9:10 am Dec 3, 2015
U.K. Search Engine : Mojeek
18 aristotle 10:16 pm Nov 25, 2015
YandexMetrika
2 keyplyr 10:51 pm Nov 19, 2015
Who are NETASQ?
3 topr8 9:12 am Nov 19, 2015
Distributed Hosting Reaping Network
5 Hobbs 11:14 pm Nov 18, 2015