1. Home
  2. Forums Index
  3. General SEO Issues / Crawler, Spider, and User Agent ID 4:13 am Jul 22, 2026

Forum Moderators: open

Message Too Old, No Replies

Chinese scrapers

caught ya

         

Bewenched

3:27 pm on Apr 29, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Unless you do alot of business with China you might want to block this entire range

220.181.0.0 - 220.181.255.255

I've been battling scrapers and caught one in this range.

dstiles

6:43 pm on Apr 30, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



As far as I can tell it's a server farm - at least, spot IP checks indicate this and I have it blocked as such.

It does include Baidu china and Sogou bots, which I also kill (but accept baidu japan).
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

  1. Home
  2. Forums Index
  3. General SEO Issues / Crawler, Spider, and User Agent ID 4:13 am Jul 22, 2026