Forum Moderated by: open

Crawler, Spider, and User Agent ID


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
What kind of spider is this?
WebCopier+v.2.2, ip - 24.88.11.3
2 stanleytk 12:52 pm Sep 10, 2001
UA Lifeboat
followed by Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 ).
2 bobriggs 6:09 pm Sep 8, 2001
wap spider
or is this a browser???
3 mack 2:48 pm Sep 8, 2001
A CSS and JS sniffer?
Can't track this one
5 Macguru 4:55 pm Sep 7, 2001
AtlantisSearch/0.1b webmaster@jippii.fi
195.211.11.50
2 volatilegx 5:27 pm Sep 6, 2001
bumblebee@relevare.com
12 Son_House 4:51 pm Sep 6, 2001
Mercator
TV33_Mercator_1-1.0
11 startup 3:44 pm Sep 6, 2001
A Sneaky Spider
what the heck is compete.com spidering for?
6 idiotgirl 9:18 am Sep 6, 2001
Fetch API?
2 Josk 2:25 pm Sep 5, 2001
Unidentified Crawler: (Indy Library)
Looking for any information about the following message.
2 JDDJ 7:53 pm Sep 4, 2001
Lynx viewer
doesn't see a page
4 Abe 11:50 am Sep 2, 2001
Spider
Need IDENTIFICATION
2 creepycrawler 2:50 am Aug 31, 2001
scooter-3.0.vns
new to me
10 Marcia 7:00 pm Aug 30, 2001
Is this a new spider
9 TerryS 9:24 pm Aug 29, 2001
SMS service
How do i make a SMS service?
2 ddsworld 5:03 pm Aug 29, 2001
Picsearch == deny from
2 toolman 4:36 pm Aug 29, 2001
Mysterious
24.216.220.210
3 volatilegx 11:10 pm Aug 28, 2001
How do i make a search engine?
make search engines?
9 ddsworld 4:36 pm Aug 28, 2001
Microsoft+URL+Control
65.113.184.110
4 Crazy_Fool 10:20 am Aug 28, 2001
spider identification
never seen this spider in MN before help identify
5 jnlomn 2:51 am Aug 28, 2001
MindSpider/1.0
new spider?
3 volatilegx 11:18 pm Aug 27, 2001
another one to stick in the garbage pile
5 littleman 10:44 pm Aug 27, 2001
morgue1.corp.yahoo.com
216.145.54.35
2 volatilegx 11:27 pm Aug 24, 2001
list of spiders
i found this
2 mack 10:32 pm Aug 24, 2001
I don't know if anyone cares...
9 littleman 7:21 pm Aug 24, 2001