Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
New Click Adsense
Russian scam bot
23 keyplyr 2:52 am May 26, 2015
Domain Re-Animator Bot
Zombie apocalypse...
7 trintragula 2:11 am May 23, 2015
New ip class for googlebot ?
193.235.238.233
3 adresanet 1:16 am May 20, 2015
Amazon AWS Hosts Bad Bots
Continuation Thread[4] ( 1 2 3 4 )
108 incrediBILL 7:25 am May 18, 2015
SputnikBot
could be worse...
3 trintragula 7:09 pm May 17, 2015
Scraping May Be A Biological Imperative
Scraping is actually a TREME according to Stephen Hawking
11 incrediBILL 7:26 am May 16, 2015
Findxbot
new bot on the hunt
17 dupres01 8:59 pm May 13, 2015
OmniBot
Microsoft Corp.
12 Pfui 8:06 pm May 13, 2015
Googlebot-Video/1.0"
audio & video files
5 keyplyr 11:25 pm May 11, 2015
A new UA from Yahoo
YahooMobileHomerun
7 slipkid 2:54 am May 11, 2015
Bingbot odd request
11 mrtonyg 2:24 am May 10, 2015
Applebot
Fresh from Apple
18 Pfui 9:12 pm May 6, 2015
Fortinet
8 slipkid 7:48 pm May 4, 2015
github.com/typhoeus
29 aristotle 2:24 pm May 3, 2015
Success in getting annoying someone/bot stopped
Hits coming from Cablevision IP
13 slipkid 5:24 pm Apr 20, 2015
Facebook app?
4 lucy24 4:05 pm Apr 18, 2015
CrazyWebCrawler
3 lucy24 1:32 am Apr 18, 2015
cyren.com
8 keyplyr 3:15 am Apr 17, 2015
=Mozilla/5.0
17 Pfui 8:55 am Apr 12, 2015
InfoUSA/InfoGroup
2 keyplyr 9:19 pm Apr 10, 2015
yoozBot
Iran
2 Pfui 11:00 am Apr 7, 2015
IZSearch
10 keyplyr 3:51 pm Apr 5, 2015
fossmovement
2 keyplyr 2:03 am Apr 4, 2015
bingbot/3.0-alpha
11 Angonasec 8:18 am Mar 28, 2015
TosCrawler
toshiba
15 keyplyr 1:58 am Mar 28, 2015