Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| NerdyBot and the Google Cloud Google range with strange referrer[2] ( 1 2 ) |
54 | dupres01 | 11:40 am Dec 5, 2014 | ||||
| PHP Vulnerability |
3 | wilderness | 10:09 am Nov 28, 2014 | ||||
| Invalid URI in request amobee-1 |
5 | yaashul | 7:33 pm Nov 27, 2014 | ||||
| Bots sharing info |
19 | roshaoar | 9:16 pm Nov 26, 2014 | ||||
| Strange UA |
16 | wilderness | 9:14 pm Nov 25, 2014 | ||||
| delay question |
3 | roshaoar | 5:02 pm Nov 24, 2014 | ||||
| Gb of Bandwidth for 403s Bandwidth over the limit once a day |
10 | not2easy | 3:32 pm Nov 24, 2014 | ||||
| double agents? |
4 | lucy24 | 4:16 am Nov 10, 2014 | ||||
| Microsoft Insitesbot |
7 | Hobbs | 6:00 pm Nov 8, 2014 | ||||
| Strange Mobile Visits. |
12 | bobothecat2 | 7:44 pm Oct 19, 2014 | ||||
| What do we do with all the IP blocks gathered? What technology to block crawlers, .htaccess or scripts? |
22 | dougwilson | 7:06 pm Oct 15, 2014 | ||||
| WebTarantula Tools They have their own nasty browser, toolbar, and bots |
9 | Angonasec | 7:11 pm Oct 12, 2014 | ||||
| stremorbot |
7 | wilderness | 10:14 am Oct 6, 2014 | ||||
| 141 Class A |
5 | wilderness | 1:13 am Oct 6, 2014 | ||||
| Don't understand this log entry |
15 | aristotle | 10:36 am Sep 21, 2014 | ||||
| ContextAdbot IP updates |
6 | lucy24 | 1:31 am Sep 3, 2014 | ||||
| GTT bots You may want to fine tune your blocks: I don't |
5 | Angonasec | 12:22 pm Aug 27, 2014 | ||||
| strange googlebot referer googlebot referral from odd site |
9 | dupres01 | 7:06 am Aug 27, 2014 | ||||
| xovibot |
7 | lucy24 | 7:05 pm Aug 25, 2014 | ||||
| odd apple requests strange requests coming from apple ramge |
6 | dupres01 | 6:20 pm Aug 24, 2014 | ||||
| IPv6 enabled Bots / Server Farm |
8 | Ocean10000 | 6:24 pm Aug 18, 2014 | ||||
| Googlebot and iPhone |
30 | wilderness | 1:41 pm Aug 17, 2014 | ||||
| Manticore (more AWS spawn) |
5 | Pfui | 6:06 pm Aug 16, 2014 | ||||
| Enterprise Search Appliances for Scrapers? Thunderstone |
20 | not2easy | 9:56 am Aug 14, 2014 | ||||
| apache pb2.gif why do bots ask for this[2] ( 1 2 ) |
44 | dupres01 | 4:46 am Aug 12, 2014 |