Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| h-208-12-52-94.netscape.com - Robozilla/1.0 Who's this? Any ideas? |
4 | mivox | 12:03 pm Jan 15, 2001 | ||||
| Spiders I Hate I really HATE to see this in my logs! |
13 | scott | 8:56 pm Jan 14, 2001 | ||||
| Newbie - Can spiders go bezerk? This spider sucks the same page over and over again |
8 | Macguru | 12:07 am Jan 14, 2001 | ||||
| Sc2_Merc_resh_37_1_C-1.0 Is this new |
2 | BoneHeadicus | 6:10 pm Jan 13, 2001 | ||||
| A new visitor from Google? Hopefully the unblocking agent! |
5 | makemetop | 9:23 am Jan 13, 2001 | ||||
| inktomi1-mid.server.ntl.com whodat? |
3 | BoneHeadicus | 12:05 am Jan 12, 2001 | ||||
| Robot from Cisco Systems? |
6 | msgraph | 6:07 pm Jan 10, 2001 | ||||
| Whatzup? |
23 | BoneHeadicus | 11:11 pm Jan 8, 2001 | ||||
| What spider is this? ru-robot |
4 | merlin78 | 4:54 am Jan 8, 2001 | ||||
| New sighting: JennyBOt/0.1 |
3 | skirril | 2:48 am Jan 8, 2001 | ||||
| vspider |
2 | Steph | 2:08 am Jan 8, 2001 | ||||
| Fast's Mozilla spider |
11 | littleman | 7:07 pm Jan 6, 2001 | ||||
| Newbie - what is cr001.digital-integrity.com? Are we beeing checked for cloaking? |
5 | Macguru | 8:24 am Jan 6, 2001 | ||||
| DirectHit new ips |
5 | PeteU | 9:11 pm Jan 5, 2001 | ||||
| Slurp or what ? suspicious spider |
4 | ulstrup | 3:05 pm Jan 4, 2001 | ||||
| Googlebot IP's |
5 | 2_much | 12:52 pm Jan 4, 2001 | ||||
| MARS SV user agent |
3 | msgraph | 10:45 am Dec 22, 2000 | ||||
| Average traffic percentage of spider visits |
15 | WebRookie | 8:08 pm Dec 19, 2000 | ||||
| oBot ((compatible;Win32)) |
3 | Steph | 3:13 pm Dec 19, 2000 | ||||
| etchels-indexer? Anyone knows this spider? |
2 | skirril | 1:18 am Dec 19, 2000 | ||||
| Does anyone know which spiders get confused by frames? |
2 | White_Rabbit | 10:26 pm Dec 18, 2000 | ||||
| Another Slurp Mozilla spider |
5 | msgraph | 7:11 pm Dec 15, 2000 | ||||
| Does sympatico.ca run spiders? 64.228.216.145 Mozilla/4.5 [en] (Win98; I) |
6 | han solo | 5:19 pm Dec 13, 2000 | ||||
| Who's This? atrax2.pa-x.dec.com (Mercator-2.0) |
3 | mivox | 1:24 pm Dec 12, 2000 | ||||
| Ink Great White Crawl |
2 | Brett_Tabke | 9:28 pm Dec 8, 2000 |