Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| RufusBot "Selects and repackages" web site pages? |
15 | bouncybunny | 6:25 pm Apr 8, 2007 | ||||
| Human or Bot? |
6 | Mokita | 5:54 pm Apr 8, 2007 | ||||
| RufusBot |
2 | writer51 | 3:05 am Mar 31, 2007 | ||||
| Microsoft Office Existence Discovery Appears to be human powered but not sure. |
3 | GaryK | 7:27 pm Mar 26, 2007 | ||||
| EmeraldShield.com robots rules don't apply to them |
3 | koan | 11:03 pm Mar 25, 2007 | ||||
| Deny Morfues [expletive deleted] Scanner |
2 | TheDuDe | 7:32 pm Mar 23, 2007 | ||||
| guglibot Anyone heard of this one? |
3 | malachite | 10:24 am Mar 22, 2007 | ||||
| CazoodleBot formerly nutch |
10 | keyplyr | 5:21 am Mar 20, 2007 | ||||
| New MS Search UA? |
3 | GaryK | 1:55 pm Mar 13, 2007 | ||||
| fembot Is this new? |
3 | Mokita | 11:01 pm Mar 12, 2007 | ||||
| Strange user agent |
2 | fischermx | 10:33 pm Mar 12, 2007 | ||||
| Is it possible ;) |
13 | wilderness | 5:34 pm Mar 6, 2007 | ||||
| MSN IP's? |
8 | Brett_Tabke | 2:20 pm Mar 6, 2007 | ||||
| why dont we see spiders in Live chat softwares sorry for this foolish query |
3 | benevolent001 | 3:15 am Mar 5, 2007 | ||||
| Unvoluntary banning googles sitemap crawler? What the bot name or ip is? |
3 | silverbytes | 7:52 pm Mar 2, 2007 | ||||
| Possible Bot or Spammer? Or is this Live bot? |
11 | EarleyGirl | 9:49 pm Feb 28, 2007 | ||||
| HoneyNet White Paper : Know your Enemy: Web Application Threats |
3 | Brett_Tabke | 7:36 pm Feb 28, 2007 | ||||
| OT: convoluted UA |
2 | Mokita | 6:17 pm Feb 26, 2007 | ||||
| Java/1.x.x Ban them or ignore them? |
9 | bouncybunny | 9:29 pm Feb 18, 2007 | ||||
| Web Accelerators Characteristics? |
2 | vortech | 1:44 am Feb 15, 2007 | ||||
| WinkBot |
2 | wilderness | 11:27 pm Feb 12, 2007 | ||||
| "CiteBite" - will duplicate your content for you No UA, no robots.txt |
9 | zCat | 7:07 am Feb 12, 2007 | ||||
| Amazon |
13 | wilderness | 10:43 am Feb 11, 2007 | ||||
| Botnet 'pandemic' threatens internet [2] ( 1 2 ) |
37 | Brett_Tabke | 3:02 am Feb 9, 2007 | ||||
| SnapPreviewBot |
10 | keyplyr | 2:48 am Feb 9, 2007 |