Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Cuil |
9 | ning | 9:59 am Oct 15, 2008 | ||||
| itsapic.com crawler |
6 | keyplyr | 3:41 pm Oct 14, 2008 | ||||
| #*$!Bot |
2 | keyplyr | 1:51 am Oct 12, 2008 | ||||
| nrsbot |
5 | wilderness | 7:21 pm Oct 11, 2008 | ||||
| fake Google |
9 | wilderness | 3:56 am Oct 11, 2008 | ||||
| Leon |
2 | keyplyr | 7:06 pm Oct 4, 2008 | ||||
| HPAutoRun |
3 | keyplyr | 12:41 am Oct 3, 2008 | ||||
| Yahoo Python Yahoo using a common site scraper |
6 | dstiles | 10:06 pm Oct 1, 2008 | ||||
| Bluecoat - good or bad? Bluecoat sometimes seems to be a baddie |
4 | dstiles | 3:32 pm Oct 1, 2008 | ||||
| Gotta love this one from Amazon They'll stop crawling depending on my attitude! |
4 | GaryK | 2:32 am Oct 1, 2008 | ||||
| New Wave of SQL Injection Vulnerability Probes List of sites being compiled for future attacks[2] ( 1 2 ) |
45 | smokeybarnable | 9:36 pm Sep 29, 2008 | ||||
| crawly 2.6.3 |
2 | keyplyr | 1:43 pm Sep 29, 2008 | ||||
| Mozilla/4.0 (PSP (PlayStation Portable); 2.00) Novarra-Vision/7.3 More crap from Yahoo? |
6 | GaryK | 10:09 pm Sep 28, 2008 | ||||
| MSN/Live MSMOBOT User-agent string change User-agent string changed |
5 | jdMorgan | 7:58 am Sep 28, 2008 | ||||
| Google Chrome UA Covered in Apple Sauce |
6 | incrediBILL | 6:02 pm Sep 25, 2008 | ||||
| Netdirect-net When will this stop? |
3 | blend27 | 1:30 am Sep 23, 2008 | ||||
| UA Grazr/v2.0 this bot is crawling my site |
6 | susanrb | 2:33 am Sep 22, 2008 | ||||
| Yahoo! Verifier Yet another Yahoo robot |
11 | jdMorgan | 8:33 pm Sep 19, 2008 | ||||
| baiduspider indexing like crazy How to limit the crawling speed |
3 | mainspot | 6:02 am Sep 19, 2008 | ||||
| Firebat 2.8.2 what's this? |
2 | smallcompany | 1:46 pm Sep 18, 2008 | ||||
| bsalsa for beginners |
8 | Samizdata | 12:22 am Sep 15, 2008 | ||||
| +QQDownload+1.7 Any idea what this is |
4 | Vimes | 11:35 pm Sep 12, 2008 | ||||
| Whitevector Crawler |
16 | vordmeister | 11:21 pm Sep 12, 2008 | ||||
| What is DoCoMo/1.0/N505i/c20/TB/W20H10 ? |
8 | gringogigi | 4:45 pm Sep 12, 2008 | ||||
| WebAlta Crawler |
18 | keyplyr | 12:29 am Sep 12, 2008 |