Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Vancouver 0.9
from microsoft
2 GaryK 10:34 pm Sep 16, 2010
New UA spotted : hoge (co2h2onacl.)
Any idea on this one?
4 Web_Savvy 9:09 pm Sep 16, 2010
Wire
(a "Bot,Robot,Spider,Crawler")
5 Pfui 7:37 am Sep 16, 2010
Twitterbot
follow-up to old thread
3 GaryK 6:04 am Sep 16, 2010
iSense bot
When will these bots learn to read?
5 Dijkgraaf 7:23 pm Sep 15, 2010
Huaweisymantecspider
4 Dijkgraaf 6:55 pm Sep 15, 2010
SaladSpoon/ShopSalad
Bad bots never die, they just smell that way
4 Dijkgraaf 10:00 pm Sep 13, 2010
Bingbot Reminder, October 1
3 engine 9:15 pm Sep 11, 2010
czxt2s User Agent?
What is this? Very odd.
20 grandma_genie 4:43 pm Sep 9, 2010
Adware or Spyware in User Agent string
Is this a problem or just infected visitor?
16 grandma_genie 4:28 am Sep 7, 2010
Sitedossier
possible data miner
3 Mokita 4:17 am Sep 7, 2010
HBZ-Digibib
2 Pfui 10:45 pm Sep 3, 2010
Dom2Dom
15 Pfui 11:10 pm Sep 2, 2010
thenewpush.com
Server farm pushes bad/fake UAs
2 Pfui 9:35 pm Sep 2, 2010
What is heritrix? Who is Darwin?
Found in User Agent. Should I block these?
12 grandma_genie 7:17 pm Aug 31, 2010
Who is Tweatbot?
Found this bot all by itself in server logs.
6 grandma_genie 3:43 pm Aug 31, 2010
Microsoft Bing Mobile SocialStreams Bot
3 Pfui 12:28 am Aug 30, 2010
PSS-Bot
2 keyplyr 10:19 am Aug 26, 2010
msnbot to bingbot?
2 keyplyr 6:53 am Aug 25, 2010
crawl.mp3realm.org
Another maggot.
2 jmccormac 5:51 pm Aug 24, 2010
schluetersche
German bot
3 Dijkgraaf 4:21 am Aug 24, 2010
Who is Kosmix?
New crawler sighted in server logs.
14 grandma_genie 10:02 pm Aug 21, 2010
zerozero88
3 MxAngel 12:34 am Aug 21, 2010
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:x.x.x) Gecko/200411
Fake UA
2 Dijkgraaf 4:27 am Aug 20, 2010
Hailoobot
New Search Engine for Middle East
3 Dijkgraaf 2:06 am Aug 19, 2010