Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Level 3 Communications
Anyone getting hits from 8.11.2.xx?
10 Bewenched 12:44 am Nov 1, 2012
Web Form Spammer
46.105.116.179
2 Bewenched 9:53 pm Oct 31, 2012
intelium bot
4 Ken_S 9:50 pm Oct 31, 2012
On Demand Cloud Servers
Enzu.com 199.229.232.xx
2 Bewenched 8:33 pm Oct 31, 2012
JikeSpider (china)
1.202.219.5
2 Bewenched 7:13 am Oct 31, 2012
Ukranian Colocation
Utel DataCenter, Ukraine (RIPE)
3 Bewenched 6:44 am Oct 31, 2012
Amazon Image Cache/0.5 libwwwperl/5.808
9 brokaddr 1:34 am Oct 31, 2012
Get Request
11 Ken_S 10:40 am Oct 27, 2012
A1colo
7 wilderness 12:20 am Oct 27, 2012
Seoanalyzer Bingbot
bingbot user agent
12 grandma_genie 12:20 am Oct 27, 2012
PowerPoint as User Agent
4 lucy24 9:21 am Oct 26, 2012
Had an interesting visitor today 173.194.73.xxx
Google? Looks like their hosting MarkMonitor
3 Bewenched 2:15 am Oct 26, 2012
Amazon bot and friends?
Possible botnet visit?
6 grandma_genie 1:32 am Oct 26, 2012
The return of Choopa
173.199.116.xxx and 173.199.114.xxx
9 Bewenched 12:41 am Oct 26, 2012
Nobis
9 keyplyr 10:16 pm Oct 25, 2012
Hetzner Online AG Data Centers
176.9.31.xx
5 Bewenched 8:13 pm Oct 25, 2012
EGIHosting
7 keyplyr 2:42 pm Oct 25, 2012
Hurrican Electric
who are these guys
4 Bewenched 2:36 pm Oct 25, 2012
A comprehensive list of EC2 IP ranges
17 bakedjake 2:35 pm Oct 25, 2012
strange refer
6 wilderness 10:45 am Oct 24, 2012
possible botnet
15 wilderness 9:47 pm Oct 20, 2012
the return of the ahrefsbot
8 lucy24 5:10 pm Oct 20, 2012
eSyndiCat Bot
2 keyplyr 4:10 pm Oct 20, 2012
Facebook ?
69.171.xxx.x
12 Bewenched 2:59 pm Oct 20, 2012
Google Web Preview
4 wilderness 9:33 pm Oct 18, 2012