Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Rumours-Agent Site downloader? |
6 | pendanticist | 7:19 pm Dec 17, 2002 | ||||
| DA5.0 come to my site and downloal stuff. I don mind traffic, but .. |
2 | Penguinsnob | 7:17 pm Dec 17, 2002 | ||||
| Page Beamer Web Accelorator |
2 | carfac | 8:09 pm Dec 16, 2002 | ||||
| Hungry Bot |
16 | menyak | 1:35 pm Dec 16, 2002 | ||||
| ArcNet - over 1000 requests? |
7 | billdaly | 8:14 pm Dec 15, 2002 | ||||
| Summation Script |
2 | DavidT | 7:40 pm Dec 15, 2002 | ||||
| links manager robot Identity |
3 | Need_More_Hits | 3:18 pm Dec 15, 2002 | ||||
| Mysterious User Agents [3] ( 1 2 3 ) |
76 | ratman | 4:17 pm Dec 14, 2002 | ||||
| FreeFind.com viral marketing banned at the firewall |
10 | Finder | 7:52 pm Dec 13, 2002 | ||||
| lcabotAccept who does this belong to? |
7 | Finder | 7:40 pm Dec 13, 2002 | ||||
| Mercator and Altavista? |
4 | HuhuFruFru | 7:12 pm Dec 13, 2002 | ||||
| Szukacz violating robots.txt Polish search engine |
2 | Finder | 7:07 pm Dec 13, 2002 | ||||
| Coincidence? |
3 | wilderness | 6:39 pm Dec 13, 2002 | ||||
| 4.38.68.69 unknown crawler |
3 | Orange_XL | 8:25 am Dec 13, 2002 | ||||
| Python-urllib/2.0a1 |
5 | troels_nybo_nielsen | 3:51 pm Dec 12, 2002 | ||||
| attempts on form processing why does this occur |
3 | sfielder | 4:44 pm Dec 11, 2002 | ||||
| Unknown bot - amzn_assoc anyone sen it? |
25 | upside | 9:59 am Dec 11, 2002 | ||||
| Almaden |
4 | Bluestreak | 1:44 pm Dec 10, 2002 | ||||
| Ugly looking User-agent |
6 | Bluestreak | 6:16 am Dec 10, 2002 | ||||
| CONNECT xxx.xxx.xxx.xxx? |
4 | skirril | 10:04 pm Dec 9, 2002 | ||||
| MFHttpScan |
3 | Duckula | 12:27 pm Dec 9, 2002 | ||||
| Spider deliberately looking for Disallow: content Bad bot 199.231.148.148 (URL_Spider_SQL/1.0) |
5 | Romeo | 3:48 am Dec 9, 2002 | ||||
| Schmozilla? |
7 | Spearmaster | 9:18 pm Dec 8, 2002 | ||||
| AlkalineBOT/1.8 Anyone seen it? Know anything? |
3 | jec2002 | 1:42 pm Dec 8, 2002 | ||||
| Csice-Agent Anyone ever seen this one? |
6 | pendanticist | 11:43 am Dec 8, 2002 |