Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| The BanBots Project site anyone knows what happened to it? |
7 | hanuman | 3:49 am May 16, 2003 | ||||
| New spider? "HTML Works 5.5" Could not find any reference to this anywhere else so thought I'd ask here. |
6 | bugblatter | 2:21 am May 16, 2003 | ||||
| NPBot? and this one is? |
4 | wkitty42 | 4:36 pm May 15, 2003 | ||||
| FTAgent Anyone seen this one? |
3 | mvl22 | 2:14 pm May 15, 2003 | ||||
| Program Shareware Spider What is it? |
2 | Bio4ce | 12:54 am May 15, 2003 | ||||
| GrigorBot 0.8 |
5 | WarmGlow | 11:14 pm May 14, 2003 | ||||
| Spider List spiders, robots |
3 | seolist | 10:48 pm May 14, 2003 | ||||
| Odd Spider Received an unknown spider |
4 | Strange | 8:37 pm May 14, 2003 | ||||
| Some unique visitors |
6 | wilderness | 5:00 pm May 14, 2003 | ||||
| Googleperson? 216.239.37.5 |
3 | coconutz | 1:25 pm May 14, 2003 | ||||
| can anyone identify this ASPseek/1.2.10 |
2 | indiandomain | 6:31 am May 14, 2003 | ||||
| AsiaNetBot anyone knows this one? |
3 | bull | 11:40 pm May 13, 2003 | ||||
| SurveyBot/2.2 |
6 | elektra | 6:56 pm May 13, 2003 | ||||
| ask.24x.info No Crawler Name 62.75.136.40 |
2 | jim_w | 12:52 pm May 13, 2003 | ||||
| Anyone heard of this one tide72.microsoft.com |
2 | totter | 7:53 am May 13, 2003 | ||||
| blocking Road Runner |
10 | cayleyv | 9:37 am May 10, 2003 | ||||
| Enticing a spider to crawl the site Robots.txt or no Robots.txt |
6 | SinclairUser | 1:01 am May 10, 2003 | ||||
| 216-239-45-4.google.com Not in adwords, so why'd it come by? |
4 | mipapage | 8:03 am May 9, 2003 | ||||
| 128.255.244.90 "Generic" Seen this one? |
2 | Busynut | 3:51 am May 8, 2003 | ||||
| misbehaved bots how to trap misbehaved bots? |
10 | indiandomain | 6:50 pm May 7, 2003 | ||||
| It's Official! MicrosoftPrototypeCrawler is legitimate! |
17 | pendanticist | 10:45 pm May 6, 2003 | ||||
| Heavy spidering from ICANN 206.196.54.148 |
6 | contracosta | 9:19 pm May 6, 2003 | ||||
| Been hit hard this month! All major SE bots visited this month |
4 | creative_craig | 12:47 pm May 6, 2003 | ||||
| 65.223.250.253 Sugar Frosted Flakes? |
22 | wilderness | 3:35 pm May 3, 2003 | ||||
| New spider or what? semanticdiscovery.com is the site but.... |
13 | coconubuck | 3:30 pm May 3, 2003 |