Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Diffbot I sent this packing a few months ago. Now it's back with a new UA |
5 | GaryK | 5:06 pm Apr 22, 2009 | ||||
| Chat Catcher |
3 | GaryK | 3:40 pm Apr 21, 2009 | ||||
| Some Opera Mobile user agents |
10 | GaryK | 2:39 am Apr 21, 2009 | ||||
| fake Googlebot? |
24 | zerillos | 2:10 am Apr 21, 2009 | ||||
| GoogleToolbar and favicon asking for it everywhere |
12 | smallcompany | 10:59 am Apr 20, 2009 | ||||
| Daumoa, Korean bot disobedient and weird UA |
4 | Mokita | 3:52 am Apr 19, 2009 | ||||
| Bad-Neighborhood Link Analyzer |
26 | GaryK | 9:27 pm Apr 16, 2009 | ||||
| Unreal |
11 | wilderness | 11:38 pm Apr 14, 2009 | ||||
| Next Generation Search Engine I'm seeing a lot of these lately |
3 | GaryK | 5:10 pm Apr 13, 2009 | ||||
| Strange MSN 2.b Bot Behavior.Hacker? Strange MSN 2.b Bot Behavior |
2 | Lain_se | 2:59 pm Apr 13, 2009 | ||||
| Microsoft crawl, no bot UA |
13 | keyplyr | 10:34 am Apr 12, 2009 | ||||
| GoogleBot Declaring itself in my tracker stats? never before have I seen this |
3 | Kristos | 11:35 pm Apr 11, 2009 | ||||
| Comtorbot |
2 | keyplyr | 5:35 pm Apr 5, 2009 | ||||
| Complete List of Yahoo Crawlers IPs addresses to block them ! How to definitively block yahoo slurp bots? |
2 | oliondor | 2:57 pm Apr 4, 2009 | ||||
| Hailoo Search Hailoo? Hailoo? Anybody Home? |
17 | incrediBILL | 8:35 am Apr 4, 2009 | ||||
| Shelob new origin |
2 | keyplyr | 10:23 am Apr 1, 2009 | ||||
| DKIMRepBot dkim-reputation.org |
10 | dstiles | 9:21 pm Mar 30, 2009 | ||||
| Can you browse the web from Outlook Express? |
6 | GaryK | 4:22 pm Mar 30, 2009 | ||||
| What is the Amazon/Kindle UA? |
5 | incrediBILL | 7:14 am Mar 29, 2009 | ||||
| freedir, tags2dir |
10 | dstiles | 10:49 pm Mar 28, 2009 | ||||
| European Web Archive europarchive.org |
2 | dstiles | 1:28 am Mar 24, 2009 | ||||
| HTTP GRANOLA and NetBarrier Firewall Header tags from Mac |
11 | dstiles | 12:11 am Mar 24, 2009 | ||||
| Osborne |
6 | wilderness | 10:30 pm Mar 23, 2009 | ||||
| bot; http:// from 216.158.1.nnn |
10 | Hobbs | 9:21 pm Mar 22, 2009 | ||||
| block whole countries best tool to lookup IP ranges |
11 | smallcompany | 3:40 pm Mar 19, 2009 |