Forum Moderators: open

Message Too Old, No Replies

iearthworm

yet another rogue crawler from Yahoo!

         

GaryK

6:18 pm on Sep 24, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



iearthworm/1.0, iearthworm@yahoo.com.cn
202.165.104.172
v30.search.cnb.yahoo.com

This was the referrer [hnol.net].

Does this look like someone abusing Yahoo! Or does it look like Yahoo! abusing us?

All it took was my favicon. It did not read robots.txt.

Signed,
Clueless In Miami
:)

keyplyr

7:15 pm on Sep 30, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



What makes you believe it's from Yahoo?


203.209.240.177 - - [30/Sep/2006:06:06:30 -0400] "GET /images/file.jpg HTTP/1.1" 200 2332 "http://imghome1.soufun.com/home/house_type_design/personalart/2005_08/13/1123937757585.jpeg" "iearthworm/1.0, iearthworm@yahoo.com.cn"

Took the one image file only. IP address is China.

thetrasher

10:52 pm on Sep 30, 2006 (gmt 0)

10+ Year Member



203.209.240.177 = mdb05.image.cn3.yahoo.com

Beijing 3721 Technology Co. Ltd belongs to Alibaba/Yahoo China.

keyplyr

12:44 am on Oct 1, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Thanks. Tool [dnsstuff.com] I use said nothing about Yahoo. In addition, it says IP address is portable.

Anyway, iearthworm/1.0 looks like an image fetcher and as such, gets added to banned UAs.

GaryK

1:30 am on Oct 1, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I did include yahoo in the rDNS in my first post. :)