Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Anyone heard of MOT 28 spider ? Anyone heard of MOT 28 spider ? |
3 | xr2boy | 4:57 pm May 6, 2002 | ||||
| What are inktomi's spiders? |
2 | korkus2000 | 3:46 pm May 6, 2002 | ||||
| Mercator? What is this user agent? |
6 | przero2 | 3:26 pm May 6, 2002 | ||||
| icorus.com No one seems to have written about this robot |
4 | misosoph | 1:06 pm May 6, 2002 | ||||
| These guys scour without UA |
3 | littleman | 2:49 am May 5, 2002 | ||||
| a few new ips and UAs |
21 | Crazy_Fool | 11:35 pm May 4, 2002 | ||||
| Australian Academic and Research Network |
2 | wilderness | 7:12 am May 4, 2002 | ||||
| Possible AOL spider detected Looking for confirmation... |
22 | Key_Master | 1:13 am May 4, 2002 | ||||
| any idea what spider this IP belongs to? |
3 | ferrari360 | 3:51 am May 3, 2002 | ||||
| fastsearch? |
2 | johnhamman | 7:53 pm May 2, 2002 | ||||
| Up to date list? |
2 | Filipe | 11:42 pm May 1, 2002 | ||||
| Inktomi just added a new Class C |
5 | volatilegx | 3:44 pm Apr 30, 2002 | ||||
| Need help with blocking this agent |
4 | willtell | 5:41 pm Apr 29, 2002 | ||||
| Ng/1.0 belongs to Exalead |
3 | volatilegx | 5:38 pm Apr 25, 2002 | ||||
| Microsoft interesting |
4 | wilderness | 5:14 am Apr 25, 2002 | ||||
| XO Communications? Who are these folks? |
12 | Friday | 4:50 pm Apr 24, 2002 | ||||
| AOL Spider AC85944C.ipt.aol.com |
5 | Friday | 8:02 am Apr 24, 2002 | ||||
| Is this a bot or a browser? |
2 | korkus2000 | 2:57 am Apr 23, 2002 | ||||
| RPT-HTTPClient/0.3-3 Nameprotect.com |
7 | wilderness | 2:33 am Apr 23, 2002 | ||||
| Search Engine Domain Identification Not Spider Listings but URL Referral Info |
5 | YadiYudi | 2:11 am Apr 23, 2002 | ||||
| spidernet help in defining this one |
2 | EliteWeb | 6:29 pm Apr 22, 2002 | ||||
| Inktomi UA was this out? |
2 | msgraph | 1:00 am Apr 21, 2002 | ||||
| DOD Web Scans Department of Defense Robots |
4 | hbarker | 10:52 pm Apr 20, 2002 | ||||
| C-Block-192 Who is this? |
9 | sdtex | 6:44 pm Apr 19, 2002 | ||||
| Who is this? I couldn't find any info on it. |
3 | RussellC | 3:15 pm Apr 19, 2002 |