Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Strange UA |
4 | wilderness | 3:39 pm Nov 13, 2007 | ||||
| Odd User Agent. Java? |
3 | Gibble | 2:56 pm Nov 6, 2007 | ||||
| Lexxe/Robot |
3 | engine | 12:58 am Nov 5, 2007 | ||||
| Searchme.com comes across as Abovenet Communications |
4 | Bewenched | 7:45 am Oct 31, 2007 | ||||
| New bot or fake? I haven't seen this one before |
4 | icedowl | 7:42 am Oct 31, 2007 | ||||
| is this a google bot/spider? |
3 | sandyk20 | 4:31 pm Oct 30, 2007 | ||||
| Mozilla/5.0 (compatible; Google Keyword Tool; +http://adwords.google.c No PTR |
3 | GaryK | 3:30 pm Oct 26, 2007 | ||||
| Google IP Range - blank UA and no Referrer Blank User Agent from Google IP range getting 403's |
2 | The_Contractor | 11:34 pm Oct 25, 2007 | ||||
| Where'd this come from? new google local search engine? |
2 | Import_Export | 9:46 pm Oct 25, 2007 | ||||
| What's Gigablast up to? trying to spider with 'languages' |
4 | malachite | 1:26 pm Oct 22, 2007 | ||||
| gigamega Fell into spider trap, no robot info at site |
5 | Receptional_Andy | 12:36 am Oct 18, 2007 | ||||
| archive.org bot/1.13.1x successor to ia_archiver? |
2 | zCat | 9:27 pm Oct 13, 2007 | ||||
| canadasearchbot |
5 | wilderness | 8:48 pm Sep 26, 2007 | ||||
| customer-reverse-entry huh? |
5 | Bewenched | 4:25 am Sep 26, 2007 | ||||
| Bots trying to find phpMyAdmin |
5 | SEOPTI | 11:12 pm Sep 22, 2007 | ||||
| Mediapartners-Google from non-Google IP Transparent spoof of a Googlebot |
2 | jdMorgan | 9:27 pm Sep 22, 2007 | ||||
| Sogou chinese bot |
3 | Bewenched | 12:56 am Sep 22, 2007 | ||||
| Mozilla/4.0 (compatible; MSIE 6.0; Windows 98) |
5 | SEOPTI | 2:41 pm Sep 19, 2007 | ||||
| Yeti |
4 | keyplyr | 1:37 pm Sep 19, 2007 | ||||
| Help identifying -who are these guys identifies itself as Danger |
4 | Bewenched | 2:30 am Sep 13, 2007 | ||||
| rv:1.8.1 - voila bot? |
2 | jake66 | 1:06 am Sep 11, 2007 | ||||
| Who have Spider Stats? I Need Thanks~~ |
2 | hostsoftware | 8:28 pm Sep 4, 2007 | ||||
| Mediapartners-Google Has Google changed the name to eliminate the version #? |
12 | GaryK | 6:33 am Sep 1, 2007 | ||||
| Why don't bots send a special header?! |
8 | mikomido | 11:39 pm Aug 30, 2007 | ||||
| EchO! Spider Agent |
2 | jshpik1 | 2:46 pm Aug 28, 2007 |