Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| CatchBot |
4 | wilderness | 11:59 pm Jul 13, 2008 | ||||
| WebSense Hiding Behind Rotating User Agents Internet Security Company Tricks Site Security |
20 | Not_academic | 4:11 pm Jul 11, 2008 | ||||
| Google 66.249.84. |
2 | wilderness | 5:33 am Jul 11, 2008 | ||||
| Googlebot / image bot causing probs? sometimes hitting 404 pg, sometimes skips |
14 | Megaclinium | 12:19 am Jul 11, 2008 | ||||
| Wanadoo some scraping? |
3 | incrediBILL | 12:18 am Jul 11, 2008 | ||||
| is bot from 207.200.116 netscape? just 'AOL 9.0' listed in UA |
4 | Megaclinium | 10:31 pm Jul 10, 2008 | ||||
| Google Web Accelerator ... it's back! |
6 | Umbra | 5:04 pm Jul 8, 2008 | ||||
| Spider testing UAs? 92.48.126.nnn |
3 | Mokita | 7:06 am Jul 8, 2008 | ||||
| Mr.Carlito |
4 | idiotgirl | 1:36 pm Jul 7, 2008 | ||||
| Register Scolds AVG For Generating Fake Traffic As Link Malware Webmasters Complain AVG Debilitating Traffic Analytics[8] ( 1 2 3 4 5 6 7 8 ) |
219 | Samizdata | 7:49 am Jul 7, 2008 | ||||
| CyberPatrol SiteCat Webbot It crawls the internet looking for harmful sites |
5 | thetrasher | 4:31 am Jul 7, 2008 | ||||
| CFNetwork/330 |
3 | Receptional_Andy | 11:23 pm Jul 6, 2008 | ||||
| get 'head' is bots? noticed new gets with this notation |
5 | Megaclinium | 5:59 am Jul 6, 2008 | ||||
| Edgy from Columbia? getting hit by new spider |
10 | Megaclinium | 3:49 am Jul 5, 2008 | ||||
| prefetch ot coincidence Msn |
6 | wilderness | 1:27 pm Jul 4, 2008 | ||||
| Nokia6300/ (botmobi) didn't ask for robotos text, has Amazon IP |
7 | idiotgirl | 1:04 am Jul 4, 2008 | ||||
| Weird Unidentified Spider |
7 | Samnwb | 10:48 pm Jul 3, 2008 | ||||
| SqwidgeBot |
4 | keyplyr | 12:32 am Jul 3, 2008 | ||||
| Which stupid bot is asking for . /foldername/google-analytics.com/ga.js' |
20 | g1smd | 11:06 pm Jul 1, 2008 | ||||
| How to design a good/nice spider? spider design |
25 | vidaj | 11:32 pm Jun 28, 2008 | ||||
| Yahoo LVLT |
9 | wilderness | 4:11 pm Jun 28, 2008 | ||||
| AVG Toolbar Glitch May Be Causing Visitor Loss User Agent Flaw Suspected[6] ( 1 2 3 4 5 6 ) |
173 | Umbra | 11:16 pm Jun 27, 2008 | ||||
| How to block all those sites that collect site info and past them on there site, a little like alexa, but with whois.... |
2 | zeus | 2:10 am Jun 21, 2008 | ||||
| PRCrawler Emerges From Stealth Mode as Kindsight ISPs to insert their own ads under guise of security software? |
12 | incrediBILL | 2:05 am Jun 21, 2008 | ||||
| Yahoo under Linux UA |
4 | Staffa | 1:50 am Jun 21, 2008 |