Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Ano-Kato
Greek SE
3 volatilegx 2:18 pm Aug 1, 2003
zeus 41852 webster pro v2.9 win32?
zeus 41852 webster pro v2.9 win32 bot
4 mcavill 10:11 am Aug 1, 2003
DigExt
4 Tonearm 12:35 am Aug 1, 2003
QuePasaCreep v0.9.13 from ipa 69.28.130.229
new semi-bogus spider?
18 rodent 9:01 am Jul 31, 2003
Anyone recognise this?
2 davelms 7:40 pm Jul 30, 2003
New Exalead UA string?
3 jrobbio 12:44 am Jul 30, 2003
Spoofing LookSmart?
Fell into Spider Trap
2 frontpage 11:50 pm Jul 29, 2003
Anybody recognise this ip?
Just checking the log's when I found this
13 Glovebox 10:55 pm Jul 29, 2003
allowing 403 page to denied IPs
5 nancyb 10:40 pm Jul 29, 2003
AOLserver
2 wilderness 4:40 pm Jul 29, 2003
Dolly/1.0
Anyone else see this?
8 Finder 9:41 pm Jul 28, 2003
216.88.0.0-216.91.255.255
Savvis Communications - why spidering?
6 trillianjedi 5:55 pm Jul 28, 2003
Another one banned
7 cyberkat 2:40 pm Jul 28, 2003
Typical spider activity
beginner's question
2 Mr_Busby 3:26 am Jul 28, 2003
WebTV and Verio
5 wilderness 4:10 am Jul 27, 2003
why are spiders bad?
sorry if this is a rookie question
12 SammiGirl 12:33 am Jul 27, 2003
Fake GoogleBot?
Korean NaverRobot bot masking as "GoogleBot"
6 Romeo 3:57 pm Jul 26, 2003
Fake Dynamic IP changing continusly
Robot with Dynamic changing IP
3 nilloc 3:13 pm Jul 26, 2003
Any ideas: arirang_check
What is it?
3 animator 5:13 pm Jul 25, 2003
Flash Processor
Anyone has seen this spider?
2 bilalak 5:42 am Jul 25, 2003
New COMBINE spider detected
Ban this spider
2 Digger 2:52 pm Jul 24, 2003
MediaPartners spider
Ban this one
2 Digger 7:42 pm Jul 23, 2003
Gaisbot/3.0
info?
5 coyote 10:43 am Jul 23, 2003
he is back look UE - Mediapartners-Google/2.1
he is back look UE - Mediapartners-Google/2.1
2 StopSpam 10:22 pm Jul 22, 2003
An aggressive spider - does anyone know it?
6 mrdch 6:15 pm Jul 22, 2003