Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Eurobot |
2 | keyplyr | 4:25 pm Aug 20, 2009 | ||||
| MS weirdness |
5 | keyplyr | 3:12 pm Aug 19, 2009 | ||||
| baypup/1.1 (Baypup; http://www.baypup.com/; jason@baypup.com) |
3 | GaryK | 3:28 pm Aug 17, 2009 | ||||
| Thunderstone |
2 | wilderness | 6:23 am Aug 17, 2009 | ||||
| Website Explorer/0.9.9.7 |
2 | GaryK | 11:51 pm Aug 16, 2009 | ||||
| Sosospider Another Rude Spider |
3 | Ocean10000 | 8:22 pm Aug 16, 2009 | ||||
| What is User Agent "U" found user agent or bot in our logfiles, dientified by U |
8 | Poolcenter | 7:11 pm Aug 15, 2009 | ||||
| atraxbot/0.2 |
16 | keyplyr | 6:46 pm Aug 11, 2009 | ||||
| Google proxy junk |
3 | dstiles | 7:04 pm Aug 10, 2009 | ||||
| Rewrite ranges |
12 | wilderness | 2:40 am Aug 10, 2009 | ||||
| pigmej, wykop/0.3 |
18 | Pfui | 10:05 pm Aug 9, 2009 | ||||
| http://www.amagit.com/ distributed search engine posing as a "new web" browser |
3 | GaryK | 3:43 pm Aug 9, 2009 | ||||
| Mozilla/5.0 (compatible; Firefox Addon; Windows XP 5.1) |
2 | GaryK | 3:35 pm Aug 9, 2009 | ||||
| southwebventures.com |
2 | keyplyr | 2:55 pm Aug 7, 2009 | ||||
| 50.nu |
4 | Pfui | 9:09 am Aug 7, 2009 | ||||
| Colo's |
9 | wilderness | 3:26 am Aug 7, 2009 | ||||
| Dav |
9 | wilderness | 1:50 pm Aug 6, 2009 | ||||
| Sogou web robot New UA format |
2 | GaryK | 7:29 am Aug 6, 2009 | ||||
| YahooMobile/1.0 (Resource; Server; 1.0.0) |
5 | GaryK | 10:06 pm Aug 5, 2009 | ||||
| Mozilla/4.0 (compatible; MSIE 4.01; Windows CE; PPC) Is this SoftLayer? |
7 | GaryK | 11:26 pm Aug 3, 2009 | ||||
| your-server.de hosts bad bots -- findfiles.net, heritrix, Mr. X, GrubNG, Eurobot, etc. |
10 | Pfui | 10:53 pm Aug 3, 2009 | ||||
| nu tch |
9 | wilderness | 7:41 pm Aug 3, 2009 | ||||
| DoubleVerify Crawler |
3 | GaryK | 4:27 pm Aug 3, 2009 | ||||
| WebsiteWorth v1.0 Website worth calculator |
3 | GaryK | 3:35 pm Aug 3, 2009 | ||||
| grabber.exe Screenshot creator |
2 | GaryK | 8:17 am Aug 3, 2009 |