Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Proactive vs. Reactive IP Range Blocking General Policy or Behavior Based |
7 | incrediBILL | 9:36 pm Nov 9, 2012 | ||||
| Amazon motherload |
4 | Bewenched | 11:48 pm Nov 8, 2012 | ||||
| MaxPointCrawler / maxpointinteractive.com 208.123.79.68 |
4 | Bewenched | 3:17 pm Nov 7, 2012 | ||||
| Wowrack |
10 | keyplyr | 9:11 am Nov 7, 2012 | ||||
| EasouSpider |
4 | keyplyr | 6:58 am Nov 7, 2012 | ||||
| odd behavior 216.38.216.101 |
5 | Bewenched | 6:34 am Nov 7, 2012 | ||||
| Strange Inktomi Corporation IP |
11 | SEOPTI | 1:44 pm Nov 6, 2012 | ||||
| orchestr8 66.35.60.158 |
5 | Bewenched | 7:32 am Nov 6, 2012 | ||||
| Does amazon have a crawler or are all Amazon AWS IPs fair game? |
9 | bigtoga | 6:57 am Nov 6, 2012 | ||||
| New google IP range 173.194/16 |
19 | dstiles | 1:03 pm Nov 5, 2012 | ||||
| Microblog-Explorer/0.3 Freie Universitaet Berlin |
3 | keyplyr | 8:53 pm Nov 4, 2012 | ||||
| elefent/Elefent 1.1 |
4 | keyplyr | 11:45 pm Nov 3, 2012 | ||||
| TotientBot new bot sighting |
3 | incrediBILL | 10:21 pm Nov 3, 2012 | ||||
| well, THAT didn't take long 176.123.0.0/19: from bogon to blocked in one easy step |
4 | lucy24 | 10:42 am Nov 2, 2012 | ||||
| Level 3 Communications Anyone getting hits from 8.11.2.xx? |
10 | Bewenched | 12:44 am Nov 1, 2012 | ||||
| Web Form Spammer 46.105.116.179 |
2 | Bewenched | 9:53 pm Oct 31, 2012 | ||||
| intelium bot |
4 | Ken_S | 9:50 pm Oct 31, 2012 | ||||
| On Demand Cloud Servers Enzu.com 199.229.232.xx |
2 | Bewenched | 8:33 pm Oct 31, 2012 | ||||
| JikeSpider (china) 1.202.219.5 |
2 | Bewenched | 7:13 am Oct 31, 2012 | ||||
| Ukranian Colocation Utel DataCenter, Ukraine (RIPE) |
3 | Bewenched | 6:44 am Oct 31, 2012 | ||||
| Amazon Image Cache/0.5 libwwwperl/5.808 |
9 | brokaddr | 1:34 am Oct 31, 2012 | ||||
| Get Request |
11 | Ken_S | 10:40 am Oct 27, 2012 | ||||
| A1colo |
7 | wilderness | 12:20 am Oct 27, 2012 | ||||
| Seoanalyzer Bingbot bingbot user agent |
12 | grandma_genie | 12:20 am Oct 27, 2012 | ||||
| PowerPoint as User Agent |
4 | lucy24 | 9:21 am Oct 26, 2012 |