1. Home
  2. Forums Index
  3. General SEO Issues / Crawler, Spider, and User Agent ID 2:28 pm May 21, 2026

Forum Moderators: open

Message Too Old, No Replies

EasouSpider

         

keyplyr

1:38 am on Nov 1, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Attempted site scrape. I block all known China ranges. Took about 50 403s very fast before it quit.

robots.txt: no
auto-referrer

Chinanet
183.0.0.0 - 183.63.255.255

keyplyr

7:13 pm on Nov 1, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Day 2 - Still eating 403s, same IP: 183.60.212.160

dstiles

8:33 pm on Nov 1, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I have a note of several bad hits within 183.60.0.0/16 so have blocked the full /16.

Bewenched

6:58 am on Nov 7, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Had a visit the other day from them as well. Thanks guys... blocked and chasing their tails.

Some piss me off enough that I forward them on to another bot ip ... lol.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

  1. Home
  2. Forums Index
  3. General SEO Issues / Crawler, Spider, and User Agent ID 2:28 pm May 21, 2026