Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| What is Bing's / Yahoo's mobile bot user-agent string? |
4 | jersey_guy | 1:58 pm Mar 24, 2011 | ||||
| Visitor using Yahoo proxy. Why? User Agent string remains the same. |
12 | grandma_genie | 3:32 am Mar 24, 2011 | ||||
| Microsoft Office user agent type of the agent |
3 | BarataPT | 8:07 am Mar 20, 2011 | ||||
| Google Wireless Transcoder Is this a cell phone user agent? |
22 | grandma_genie | 5:35 am Mar 10, 2011 | ||||
| As8075 Microsoft |
3 | wilderness | 10:34 pm Mar 9, 2011 | ||||
| Stopping scrapers from the get-go [2] ( 1 2 ) |
46 | wheel | 3:18 am Mar 4, 2011 | ||||
| Internet Archive's Archive-It '[Subscribers] harvest, catalog, manage...' |
8 | Pfui | 1:23 am Mar 3, 2011 | ||||
| GoogleBot from China First time for me, |
5 | blend27 | 11:07 pm Mar 2, 2011 | ||||
| Abuse from a Google IP range |
4 | Mokita | 10:27 pm Feb 20, 2011 | ||||
| a new bot bot |
3 | mojomike | 1:14 am Feb 19, 2011 | ||||
| Dragon135 Suspicious crawler leading back to strange open directory |
8 | Maintainer | 9:09 pm Feb 17, 2011 | ||||
| Windows Live Social Object Extractor ? |
2 | Umbra | 12:34 am Feb 17, 2011 | ||||
| Exalead ? Massive spidering |
2 | Bewenched | 12:27 am Feb 17, 2011 | ||||
| LightSpeedSystems Why Spoof? |
3 | TheMadScientist | 5:18 am Feb 16, 2011 | ||||
| Exabot Thumbnails Block or not to block? |
2 | tangor | 1:07 pm Feb 12, 2011 | ||||
| WordPress |
4 | Umbra | 8:36 pm Feb 11, 2011 | ||||
| What is the ADM token for? |
4 | GaryK | 9:24 pm Feb 10, 2011 | ||||
| RockMelt |
6 | TheMadScientist | 11:42 pm Feb 9, 2011 | ||||
| Bot Blocking in IPV6 what's your strategy? |
7 | incrediBILL | 11:07 pm Feb 4, 2011 | ||||
| Googlebot acting strangely Finding it in error logs |
6 | grandma_genie | 3:52 am Feb 4, 2011 | ||||
| KKman2.0 With Strange Characters in Logs |
6 | OnThePike | 4:59 pm Feb 3, 2011 | ||||
| Is this IP google? |
4 | zerillos | 9:28 am Feb 3, 2011 | ||||
| Yellow Pages USA what is its bot UA? |
10 | dstiles | 4:37 pm Feb 2, 2011 | ||||
| BigPanda new search site crawler |
6 | Mokita | 7:30 pm Feb 1, 2011 | ||||
| Blocking Navigator 98 User Agent and NT 4.0 |
8 | incrediBILL | 10:30 pm Jan 30, 2011 |