Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| 168.71.5.202 and a loopy Roadrunner |
2 | coyote | 2:05 pm Jun 27, 2003 | ||||
| Mozilla/8.0 stupid spammer and other bots |
4 | coyote | 11:16 pm Jun 26, 2003 | ||||
| SiteWinder heads-up |
3 | wilderness | 11:01 pm Jun 26, 2003 | ||||
| MicrosoftPrototypeCrawler - Is it new? It came to my site. |
9 | IITian | 4:46 pm Jun 26, 2003 | ||||
| MarkWatch/1.0 snoopbot another IP to add to the block list |
2 | nativenewyorker | 11:13 pm Jun 25, 2003 | ||||
| Univ. of Aizu Web Crawler New *evil* spider |
4 | dcheney | 9:09 pm Jun 25, 2003 | ||||
| MnogoSearch just a heads up |
3 | wilderness | 7:07 pm Jun 24, 2003 | ||||
| 194.203.75.29 heads up |
4 | wilderness | 11:06 pm Jun 23, 2003 | ||||
| Custo just noticed this |
2 | carfac | 4:43 pm Jun 23, 2003 | ||||
| Could this be a bot? only hits homepage |
7 | too_much_information | 3:21 pm Jun 23, 2003 | ||||
| wysiwyg is this a spider unknown referre |
19 | nilloc | 2:55 pm Jun 23, 2003 | ||||
| What's This? IE+5.5+Compatible+Browser |
2 | xcandyman | 11:39 am Jun 23, 2003 | ||||
| UA for GetPageSize? |
5 | keyplyr | 11:05 pm Jun 22, 2003 | ||||
| libwww spambot or what? |
8 | coyote | 4:09 am Jun 22, 2003 | ||||
| "Pita" spider Has anyone seen this one? |
6 | nafmo | 12:35 am Jun 22, 2003 | ||||
| The economics of spidering There has to be a mutual benefit here |
2 | webdevsf | 11:20 pm Jun 21, 2003 | ||||
| Msnbot/0.1 First time I've seen this one. |
11 | volatilegx | 3:27 pm Jun 21, 2003 | ||||
| ua: Hello Now this one is nasty |
4 | FineWare | 12:05 pm Jun 21, 2003 | ||||
| Automatic identification/blocking |
2 | ephka | 5:40 pm Jun 20, 2003 | ||||
| InternetSeer.com should i block this |
4 | sajjid | 12:13 am Jun 20, 2003 | ||||
| False agent-name and False IP A real pain in the....... |
15 | sanuk | 11:00 am Jun 19, 2003 | ||||
| pleasdo as user agent? any ideas? |
2 | Clark | 9:34 pm Jun 18, 2003 | ||||
| Canadian Crawler Hammered my site Bell Nexxia? |
5 | kewlbeezer | 10:00 pm Jun 17, 2003 | ||||
| interseer or InterSeer using NC and OR is ok? |
4 | sanuk | 8:57 pm Jun 17, 2003 | ||||
| 13 | DavidT | 8:45 pm Jun 17, 2003 |