Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Webtrends Spider List Updates??? |
4 | cfel2000 | 11:46 am Mar 20, 2002 | ||||
| htaccess and rewrit rewrite bots |
7 | wilderness | 6:10 am Mar 20, 2002 | ||||
| Visit from 217.37.196.141 Looking for a path with a space |
3 | olwen | 7:32 pm Mar 19, 2002 | ||||
| zeus 60269 webster pro v2.9 win32 I searched, couldn't find anything. |
2 | mdharrold | 10:29 am Mar 17, 2002 | ||||
| suzuran from 202.13.160.44 One request from Japan for robots.txt |
2 | mbauser2 | 4:36 am Mar 17, 2002 | ||||
| Teleport Pro browser? |
2 | keyplyr | 10:36 am Mar 16, 2002 | ||||
| MzqDownload/1.0 and ia_archiver 0.0 anyone know what these are? |
7 | ritualcoffee | 3:05 am Mar 16, 2002 | ||||
| Gigablast cacheing search engine |
8 | volatilegx | 1:08 am Mar 16, 2002 | ||||
| LNSpiderguy lexis-nexis.com |
9 | idiotgirl | 12:26 am Mar 16, 2002 | ||||
| New Apache Mpodule to catch 'evil spiders' |
3 | skirril | 7:26 pm Mar 13, 2002 | ||||
| SpiderTrap Caught these IPs Some are proxies, am I losing traffic? |
18 | prozz | 1:03 am Mar 13, 2002 | ||||
| A new agent or new advertisement? Multiblocker |
24 | Tapolyai | 1:23 am Mar 11, 2002 | ||||
| Robot exclusion protocol.. |
2 | skirril | 6:18 am Mar 10, 2002 | ||||
| Scooter/1.0 Lets do the timewarp, again... |
5 | Josk | 7:19 pm Mar 9, 2002 | ||||
| BunnySlippers from Microsoft? |
4 | Machiavelli | 7:14 pm Mar 9, 2002 | ||||
| myEfinder looks like somebody's building a new engine? |
3 | volatilegx | 4:36 pm Mar 7, 2002 | ||||
| can somebody tell me if these IPs are bots or legit website visitors they constantly show up in top 10 IPs |
4 | prozz | 12:13 am Mar 7, 2002 | ||||
| Ideare an Italian Inktomi? |
3 | volatilegx | 7:13 pm Mar 6, 2002 | ||||
| dtSearchSpider |
3 | volatilegx | 4:58 pm Mar 6, 2002 | ||||
| 61.146.48.44 China again.... |
2 | Key_Master | 6:58 am Mar 6, 2002 | ||||
| nat.overture.com it is true, i see it requesting pages |
4 | EliteWeb | 12:50 am Mar 6, 2002 | ||||
| Scooter took the css-file |
2 | oLeon | 10:10 am Mar 5, 2002 | ||||
| openfind data gatherer different IP's |
4 | wilderness | 10:02 am Mar 5, 2002 | ||||
| Lockstep Spider? Anything? |
3 | zeb | 5:34 pm Mar 2, 2002 | ||||
| Fast 3.4 Nirvana - another new one? |
2 | Crazy_Fool | 5:29 pm Mar 2, 2002 |