Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Google polyfill |
8 | lucy24 | 3:34 am Feb 25, 2019 | ||||
| 104.199.128.134 |
7 | andrew_thom | 2:19 am Feb 24, 2019 | ||||
| Skotina via TOR After so many years, scrapers are still there... |
3 | blend27 | 11:49 pm Feb 13, 2019 | ||||
| URLTester |
3 | lucy24 | 6:07 am Feb 3, 2019 | ||||
| Symantec from **.broadband.digiweb.ie The range belongs to Symantec Corporation |
7 | blend27 | 10:09 pm Jan 28, 2019 | ||||
| Microsoft and 13.64.0.0/11 Legit bing-bots? BingLocalSearch? |
14 | SumGuy | 7:04 pm Jan 21, 2019 | ||||
| Discordbot |
3 | keyplyr | 2:40 am Jan 14, 2019 | ||||
| iCab/5.8.4 |
2 | TorontoBoy | 1:03 am Jan 13, 2019 | ||||
| 7Siters |
3 | TorontoBoy | 5:34 pm Dec 24, 2018 | ||||
| New Range for COCCOC bot? |
4 | blend27 | 7:34 pm Dec 15, 2018 | ||||
| facebookexternalhit |
8 | lucy24 | 2:54 pm Dec 10, 2018 | ||||
| Laserlikebot/0.1 |
2 | TorontoBoy | 4:55 am Dec 5, 2018 | ||||
| BigSkyBot 2.06 Simple site parsing agent for niche search index |
2 | mcneely | 1:57 am Nov 22, 2018 | ||||
| Falkon |
5 | lucy24 | 9:38 am Oct 31, 2018 | ||||
| OutclicksBot new UA, new range |
12 | keyplyr | 9:04 pm Oct 30, 2018 | ||||
| PocketImageCache |
2 | keyplyr | 3:11 pm Oct 24, 2018 | ||||
| Aranea Web Corpora Project |
3 | keyplyr | 6:41 am Oct 24, 2018 | ||||
| GSC >Crawl Errors >Server Connectivity |
5 | keyplyr | 3:23 am Oct 24, 2018 | ||||
| Android's Mobile Chrome "Show simplified view" undetectable in UA string |
8 | keyplyr | 1:17 am Oct 23, 2018 | ||||
| Question about Bing Preview Bing preview being used as a proxy? |
2 | SumGuy | 4:59 pm Oct 21, 2018 | ||||
| Default User Agent |
5 | keyplyr | 5:59 am Oct 19, 2018 | ||||
| WordPress.com Reader |
2 | keyplyr | 9:35 pm Oct 18, 2018 | ||||
| Google adbot is now hitting my site I don't buy or sell or connect to ad networks? |
12 | SumGuy | 4:35 am Oct 18, 2018 | ||||
| IndeedBot |
16 | TorontoBoy | 10:36 am Oct 14, 2018 | ||||
| Server farms in the age of VPNs How to consider server farms in the age of consumer VPNs |
10 | JamesSC | 8:28 am Oct 12, 2018 |