Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Overture-WebCrawler |
6 | Tor | 6:29 pm Sep 23, 2003 | ||||
| Internetseer How do I kill this parasite? |
14 | epanastatis | 11:50 pm Sep 22, 2003 | ||||
| Can anyone imagine/knows what Googlebot's Interface is like? Just wondering |
4 | sidyadav | 8:56 pm Sep 22, 2003 | ||||
| 203.24.143.197 bot used to steal? |
4 | coyote | 6:47 pm Sep 21, 2003 | ||||
| Intelliseek spybot / snoopbot / copyrightbot any other IP ranges for this pest |
2 | nativenewyorker | 6:23 pm Sep 21, 2003 | ||||
| Name Protect bot a big pest How to ban it? |
13 | mayor | 6:05 pm Sep 21, 2003 | ||||
| Program Shareware 1.0.3 What is this? |
9 | andrewrab | 1:15 am Sep 20, 2003 | ||||
| RPT-HTTPClient/0.3-3 New IBM bot or just odd browser? |
2 | claus | 11:35 pm Sep 19, 2003 | ||||
| New User_Agent "PHP/4.1.1" Who knows about this UA? |
3 | Wizcrafts | 4:27 pm Sep 19, 2003 | ||||
| New ZyBorg UA strings - again Two of them - this time featuring "Beta" |
2 | claus | 3:56 pm Sep 19, 2003 | ||||
| 27 Googlebot's on my site ...all at the same time |
5 | esllou | 6:29 pm Sep 18, 2003 | ||||
| MSIE Crawler, visits daily, follows overture listing A nasty little 'spider' that is costing me money |
4 | werty | 4:12 pm Sep 18, 2003 | ||||
| EgotoBot/4.8 spiders dmoz listing, "caching" pages |
2 | stevenha | 11:40 am Sep 16, 2003 | ||||
| Yahoo is up to something 207.126.224.174 |
4 | fiestagirl | 6:20 am Sep 16, 2003 | ||||
| baiduspider new IP for baiduspider, fwiw |
5 | kpaul | 10:24 pm Sep 15, 2003 | ||||
| 37.104 and 39.104 what are these, please? |
8 | beezee | 9:04 pm Sep 15, 2003 | ||||
| Beginner needs spider monitoring software |
4 | nicheman | 4:20 pm Sep 15, 2003 | ||||
| 64.156.198.78 from Windows to Linux within one minute |
5 | coyote | 1:14 pm Sep 15, 2003 | ||||
| IBM_Planetwide Getting hit very hard by this spider |
4 | requiem | 3:46 am Sep 15, 2003 | ||||
| Keebler elf? bot from Keebler fell in trap |
5 | coyote | 2:11 am Sep 15, 2003 | ||||
| Utse/0.04? |
8 | keyplyr | 6:24 am Sep 14, 2003 | ||||
| more 131.107. nonsense |
4 | wilderness | 6:12 am Sep 14, 2003 | ||||
| 3 | pendanticist | 5:47 am Sep 14, 2003 | |||||
| Under_the_Rainbow_2.2 from 80.58.13.107 |
3 | ServMe | 7:49 pm Sep 12, 2003 | ||||
| I'm sure you've heard this before... list of all of 'em... |
5 | andrewrab | 5:09 pm Sep 11, 2003 |