Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Bogus referrer? |
2 | skirril | 2:56 pm May 27, 2001 | ||||
| polybot 1.0 |
8 | Froggyman | 7:28 am May 27, 2001 | ||||
| unknown POST action can anyone tell me what this all about? |
11 | sedir | 11:39 am May 26, 2001 | ||||
| Anyone ever seen this... |
3 | toolman | 9:31 pm May 24, 2001 | ||||
| magick.texcpe.cableone.net Googlebot UA |
3 | sugarkane | 1:24 pm May 24, 2001 | ||||
| qestion to refuse approch |
4 | mimmo5 | 12:29 pm May 24, 2001 | ||||
| Need a spider tracking script ...In Cold Fusion or VBScript |
7 | Travoli | 2:14 pm May 23, 2001 | ||||
| Defense contractor can't set User_Agent |
3 | littleman | 10:40 pm May 21, 2001 | ||||
| Why block a Spider? |
3 | Bobby79 | 12:50 pm May 21, 2001 | ||||
| perlone perlone |
2 | bot_watcher | 6:44 pm May 18, 2001 | ||||
| I Can't ID this one 209.15.170.xxx |
5 | bobriggs | 6:09 pm May 18, 2001 | ||||
| Translators - know any IPs? Babelfish, Go Translator etc |
6 | Machiavelli | 6:47 am May 17, 2001 | ||||
| Vspider |
5 | designfreak | 9:03 am May 16, 2001 | ||||
| Is Google cloak-checking me? Or am I getting paranoid? |
2 | Doofus | 8:34 pm May 15, 2001 | ||||
| We're being attacked update no referrer, no agent ??? |
3 | joshie76 | 8:09 pm May 15, 2001 | ||||
| Knowledgebase : Spider Identification |
2 | Brett_Tabke | 3:29 pm May 15, 2001 | ||||
| A dumb question |
7 | NFFC | 7:21 am May 15, 2001 | ||||
| Weird one from Exodus... Inktomi??? Doubt it... |
6 | Kamikaze | 5:37 am May 15, 2001 | ||||
| Deep Crawlers? |
3 | 2_much | 5:30 am May 15, 2001 | ||||
| Who is this spider? |
4 | suet | 4:42 am May 15, 2001 | ||||
| Returning spider? How can we make the spidr come back? |
3 | thewebguy | 3:47 am May 15, 2001 | ||||
| What Does a Yahoo Editor Look LIke |
7 | WebThinkTank | 3:46 am May 15, 2001 | ||||
| Is this INK??? Korean INK??? |
26 | Kamikaze | 3:37 am May 15, 2001 | ||||
| Are these spiders? |
5 | scott | 3:35 am May 15, 2001 | ||||
| Who is this one ? |
12 | Steph | 6:45 pm May 14, 2001 |