Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
best-seo-solution
Hello semalt, my old friend[3] ( 1 2 3 )
61 Pfui 4:29 am Oct 9, 2015
StashBot
3 keyplyr 1:22 am Oct 9, 2015
Google favicon
[2] ( 1 2 )
54 keyplyr 8:50 am Oct 7, 2015
OpenHoseBot
6 keyplyr 6:15 pm Oct 5, 2015
unknown
11 keyplyr 2:49 pm Oct 5, 2015
Crazywebcrawler
3 keyplyr 11:07 pm Oct 2, 2015
ICAP-IOD ua
6 LordSilver 9:17 pm Sep 29, 2015
Kaywa nostat
4 keyplyr 9:44 pm Sep 22, 2015
Dorado WAP-Browser
3 keyplyr 9:08 pm Sep 22, 2015
AdlesseBot
5 keyplyr 9:35 am Sep 18, 2015
Blue Coat
3 lucy24 8:19 am Sep 16, 2015
Adblock Browser for Android
25 keyplyr 6:11 pm Sep 15, 2015
Go 1.1 package http
19 keyplyr 1:10 pm Sep 14, 2015
other people's cookies
8 lucy24 1:56 am Sep 13, 2015
the oBot returns
6 lucy24 6:50 pm Sep 10, 2015
Riddler
7 keyplyr 1:51 am Sep 8, 2015
Puffin
9 lucy24 9:27 pm Sep 7, 2015
Mysterious User Agents
6 wilderness 2:46 am Sep 7, 2015
'compatible'
8 wilderness 7:52 pm Sep 5, 2015
Block ALL bots except google
Looking for the best way to block all bots/crawlers other than google.
18 classicman 5:07 pm Sep 5, 2015
Long referers
6 dstiles 6:42 pm Sep 4, 2015
Arachnida
a spider by any other name
4 lucy24 10:35 am Aug 31, 2015
MSOffice
7 keyplyr 4:06 pm Aug 30, 2015
GozaikBot
6 keyplyr 8:49 am Aug 29, 2015
OrangeBot
3 keyplyr 7:53 pm Aug 25, 2015