Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| SaladSpoon/ShopSalad (née YowedoBot) |
4 | Pfui | 4:07 pm Aug 2, 2009 | ||||
| Computer Sciences Corporation Cloud Computing |
2 | keyplyr | 4:05 pm Aug 2, 2009 | ||||
| Huasai Another Vrtservers variation on a larbin _viewer theme? |
3 | Pfui | 3:45 pm Aug 2, 2009 | ||||
| mobile/; pda/ /iphone; . What does this bot want? bot looking for directories like mobi/; m/; /images/ixcp.css |
3 | knonymouse | 7:30 pm Jul 31, 2009 | ||||
| Microsoft and Yahoo Search Deal Agreement How will it affect search bot user agents? |
2 | GaryK | 8:02 am Jul 30, 2009 | ||||
| IBM Research's: "SAI Crawler" |
2 | Pfui | 8:41 am Jul 28, 2009 | ||||
| Google-Site-Verification/1.0 |
17 | GaryK | 8:37 pm Jul 27, 2009 | ||||
| bitlybot AWS again |
4 | GaryK | 7:24 am Jul 27, 2009 | ||||
| u n d e t e c t a b l e 4 u! |
2 | GaryK | 7:43 pm Jul 26, 2009 | ||||
| EvriStreamMiner/0.1b |
3 | keyplyr | 12:15 am Jul 25, 2009 | ||||
| jrCrawler/1.0b |
5 | Pfui | 8:40 pm Jul 24, 2009 | ||||
| Microsoft and Danger no pun |
3 | wilderness | 7:30 pm Jul 24, 2009 | ||||
| MSN fakes many things in addition to referrers... |
6 | caribguy | 9:59 pm Jul 22, 2009 | ||||
| Bare Fruit 404 redirector affilliate |
5 | dstiles | 9:42 am Jul 22, 2009 | ||||
| Purge Information from domain tools and aboutus.org? [3] ( 1 2 3 ) |
68 | doni | 2:30 am Jul 21, 2009 | ||||
| TailsweepBlogCrawler/Tailsweep |
5 | JAB_Creations | 3:33 pm Jul 17, 2009 | ||||
| Microsoft launches Azure, an AWS competitor Expect more unverifiable bots |
8 | incrediBILL | 12:59 am Jul 16, 2009 | ||||
| Slurp Gone Wild Took only disallowed files |
2 | GaryK | 9:43 am Jul 15, 2009 | ||||
| pythumbnail.py taking screenshots? |
3 | GaryK | 9:42 am Jul 15, 2009 | ||||
| Qryos |
5 | keyplyr | 9:36 am Jul 15, 2009 | ||||
| Log spam or crawler? mtrack.nl |
7 | GaryK | 6:40 am Jul 15, 2009 | ||||
| Fake Googlebots - why are they here? Asking about why there are so many fake Googlebots accessing our site. |
8 | wizboy | 3:12 am Jul 15, 2009 | ||||
| User-Agent "GbPlugin" Annoying HTTP requests for a non-existent .SWF file |
2 | jaynl | 8:44 pm Jul 14, 2009 | ||||
| Visited by http://tools.geek-tools.org Apparent log spam |
5 | GaryK | 4:49 am Jul 14, 2009 | ||||
| /(null) |
22 | Pfui | 4:12 pm Jul 13, 2009 |