Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Interesting article on blocking bots |
2 | volatilegx | 2:57 pm Jan 31, 2002 | ||||
| Overture Spider? |
4 | Josk | 2:50 am Jan 31, 2002 | ||||
| National Directory, Business.com, Splatsearch.com ? Does anybody know the names or IPs of their spiders? |
2 | snark | 1:48 am Jan 31, 2002 | ||||
| Scooter Spider is Confused? filling my error logs with junk |
3 | idiotgirl | 1:07 am Jan 31, 2002 | ||||
| Nice js solution for email harvesters |
6 | littleman | 3:29 pm Jan 30, 2002 | ||||
| Pesky bot/snooper with a bogus referrer. |
13 | littleman | 1:28 am Jan 30, 2002 | ||||
| Nico Anybody seen this one? |
2 | wilderness | 5:35 pm Jan 27, 2002 | ||||
| New AV IP out of Colorado |
6 | msgraph | 12:58 am Jan 25, 2002 | ||||
| Crawler able to follow javascript generated links |
4 | bottester | 5:02 pm Jan 24, 2002 | ||||
| How to kill the Mattie MP3 Spider This Spider is eating my bandwidth |
3 | hellier | 3:43 pm Jan 23, 2002 | ||||
| cr009r01.sac2.fastsearch.net who is this please cr009r01.sac2.fastsearch.net who is this please |
9 | rilee12 | 10:11 am Jan 22, 2002 | ||||
| About/0.1libwww-perl/5.47 |
7 | Marcia | 12:03 am Jan 20, 2002 | ||||
| new IP range for Fast spider |
4 | PeteU | 3:13 pm Jan 19, 2002 | ||||
| Whatever happened to WiseWire? Are they dead? |
3 | volatilegx | 11:09 pm Jan 15, 2002 | ||||
| A flurry of New bots (for me) over the past few days |
5 | wilderness | 5:46 pm Jan 15, 2002 | ||||
| The Informant |
13 | Froggyman | 10:22 pm Jan 14, 2002 | ||||
| sitecheck.internetseer |
9 | Marcia | 12:42 pm Jan 5, 2002 | ||||
| Aims Inc., X3@kto.takoy or (hhjhj@yahoo.com) |
8 | wilderness | 3:00 am Jan 4, 2002 | ||||
| Spider from spyglass.com Recieving multiple hits from 208.200.98.37 |
5 | Feynman | 9:35 pm Dec 30, 2001 | ||||
| crawler.tivra.com 207.140.168.143 tivraSpider/1.0 |
10 | Brett_Tabke | 7:13 pm Dec 29, 2001 | ||||
| Know this one? |
3 | agerhart | 11:01 pm Dec 27, 2001 | ||||
| Anybody seen this one? Mozilla/4.0 (compatible; Powermarks/3.5; Windows 95/98/2000/NT) |
3 | volatilegx | 7:55 pm Dec 27, 2001 | ||||
| GAISbot Who |
5 | lawman | 5:51 pm Dec 27, 2001 | ||||
| [OT] Somewhat determining what bots and etcetera to allow |
2 | wilderness | 5:28 pm Dec 23, 2001 | ||||
| wordfreqbot 1.2 Who is this ? any ideas ? h0050dac8c17b.ne.mediaone.net - wordfreqbot 1.2 |
9 | diddlydazz | 8:27 pm Dec 22, 2001 |