Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Larbin-experimental Rude bot |
5 | herb | 6:43 pm Apr 7, 2003 | ||||
| Google Visit |
11 | DavidT | 5:31 pm Apr 7, 2003 | ||||
| net-sweeper Ignored Robots.txt |
10 | frontpage | 5:15 pm Apr 7, 2003 | ||||
| Microsoft Spider poking around? seems to be behaving itself |
7 | WitchLars | 9:11 am Apr 7, 2003 | ||||
| fresh vs deep ips |
22 | Brett_Tabke | 4:43 am Apr 7, 2003 | ||||
| WebStripper I know, you probably already have it banned... |
4 | carfac | 7:11 pm Apr 6, 2003 | ||||
| WebFilter Robot 1.0 Good/Bad or just plain Ugly? |
8 | pendanticist | 4:59 pm Apr 5, 2003 | ||||
| Four visited in one day Is it unusual? |
3 | jaybee | 4:33 pm Apr 5, 2003 | ||||
| NCSA_Beta_1 The Supercomputer is after me! |
3 | bcolflesh | 4:48 am Apr 5, 2003 | ||||
| Cloaked Spider!? ...something strange went through my site! |
3 | frogg | 12:41 am Apr 4, 2003 | ||||
| WebCopier v2.8a |
10 | madmatt69 | 8:27 pm Apr 3, 2003 | ||||
| Google Confused? Is my site messing with google? |
3 | Skylo | 7:01 pm Apr 2, 2003 | ||||
| New Sighting: NexaBot/1.0 213.173.191.108 |
3 | skirril | 6:59 pm Apr 2, 2003 | ||||
| Msie 5.5 Msie 5.5 Spam |
13 | Andrue | 11:23 am Apr 2, 2003 | ||||
| openfind outdated threads |
2 | wilderness | 3:03 pm Apr 1, 2003 | ||||
| Badly-written spider Possibly using open .CA proxies |
2 | jdMorgan | 6:45 pm Mar 31, 2003 | ||||
| Filtering bots from traffic reports Agent name and/or IP address? |
6 | aspdaddy | 6:45 pm Mar 31, 2003 | ||||
| WebCapture Is this a bot? |
2 | copongcopong | 2:04 am Mar 28, 2003 | ||||
| "Generic" 128.255.244.82 |
2 | DavidT | 9:16 pm Mar 27, 2003 | ||||
| colocation |
3 | wilderness | 6:03 pm Mar 27, 2003 | ||||
| What's This? AOLserver-Tcl/3.3.1+ad13 |
3 | Oaf357 | 12:40 am Mar 27, 2003 | ||||
| When should I disable sessions? |
5 | Tonearm | 6:07 pm Mar 26, 2003 | ||||
| semanticdiscovery/0.1 A new information harvester |
18 | jdMorgan | 3:47 pm Mar 26, 2003 | ||||
| Another Japanese Bot: Aruyo/0.01 Just grabbed robots.txt |
2 | carfac | 7:27 am Mar 25, 2003 | ||||
| Unknown user agents that appear to be bots - valid spiders or proxies? Unknown user agents that appear to be bots - valid spiders or proxies? |
2 | FoodPlaces | 5:55 am Mar 25, 2003 |