Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Bad Bot is google? Bad bot scraping my site found in Google Cache |
2 | devil_dog | 2:00 am Mar 19, 2009 | ||||
| Healthbot / Health and Longevity Project Healthbot/Health_and_Longevity_Project_(HealthHaven.com) |
10 | dstiles | 7:22 am Mar 17, 2009 | ||||
| Trend Micro WebSurf Prefetcher |
3 | Samizdata | 2:29 am Mar 17, 2009 | ||||
| Iterasi.com, yet another archiving site |
3 | incrediBILL | 11:15 pm Mar 16, 2009 | ||||
| How to ID Screen Shot Tools? Make them ID themselves! |
22 | incrediBILL | 11:11 pm Mar 15, 2009 | ||||
| Charlotte/0.05 |
28 | jimji | 11:04 pm Mar 15, 2009 | ||||
| Tracing Form Spam From initial page hit to submitting form |
6 | dstiles | 7:40 pm Mar 15, 2009 | ||||
| iearthworm - yahoo-related or not? User agent string "iearthworm@yahoo.com.cn" |
3 | Marino | 4:05 pm Mar 13, 2009 | ||||
| similarpages dot com New Nutch? |
3 | tangor | 3:50 am Mar 12, 2009 | ||||
| Googlebot uses Godaddy. Update to Earlier Thread |
6 | keyplyr | 11:01 pm Mar 10, 2009 | ||||
| Surf Knight (bot@surfknight.com) |
2 | Pfui | 11:55 pm Mar 9, 2009 | ||||
| Msn |
15 | wilderness | 10:39 am Mar 8, 2009 | ||||
| Firefox 0.8+ |
4 | wilderness | 5:25 pm Mar 7, 2009 | ||||
| BotTracer; (+http://www.informacja.pl) scanning [Your URL here] Okay so this is just creepy. |
5 | Pfui | 12:26 am Mar 7, 2009 | ||||
| Safari 4 Beta Is this the right user agent? |
7 | GaryK | 10:29 pm Mar 6, 2009 | ||||
| Google OpenSocial agent Appears to be something new from Google |
3 | GaryK | 8:31 pm Mar 2, 2009 | ||||
| OpenfosBot (Korea) |
4 | Pfui | 7:21 pm Mar 2, 2009 | ||||
| Nutch in disguise? BobCrawl and Yowedo from same IP |
3 | GaryK | 3:30 am Mar 2, 2009 | ||||
| verify-Compliance Notice An unusual referer? |
9 | dstiles | 11:35 pm Mar 1, 2009 | ||||
| /msgimport / requests what is this? |
17 | smallcompany | 7:05 pm Mar 1, 2009 | ||||
| Web-non-sense aka websense, surfcontrol, mailcontrol and blackspider |
5 | caribguy | 6:45 pm Mar 1, 2009 | ||||
| DailyPerfect another scraper? |
3 | dstiles | 8:48 pm Feb 28, 2009 | ||||
| Google AdWords API |
2 | caribguy | 5:32 pm Feb 27, 2009 | ||||
| WinWebBot by balaena.com |
3 | dstiles | 4:49 pm Feb 26, 2009 | ||||
| Google IP grabbing JS and CSS only - bot? |
6 | Receptional_Andy | 2:30 pm Feb 26, 2009 |