Forum Moderators: open

Message Too Old, No Replies

AhrefsBot

née SiteBot

         

Pfui

4:34 pm on Aug 17, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



A bad bot by any other name...

213.186.122.3.utel.net.ua
Mozilla/5.0 (compatible; AhrefsBot/1.0; +http://ahrefs.com/robot/)

08/17 0n:12:30 /robots.txt
08/17 0n:12:32 /robots.txt

But don't let that fool you.

The following Project Honey Pot comments [projecthoneypot.org...] are echoed x3, as recently as last May:

Triple whammy: rule breaker, maliciously malformed URLs and more than 100 hits per minute. User Agent - "Mozilla/5.0 (compatible; SiteBot/0.1; +http[i]://www.sitebot.org/robot/)"[/i]

Something's been crawling a while from that IP, by one name or another. Also from Project Honey Pot for 213.186.122.3 --

Mozilla/5.0 (compatible; AhrefsBot/1.0; +http://ahrefs.com/robot/)
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/),gzip(gfe)

See also [webmasterworld.com...]

Last but not least...

From last May, an apparently not-so-coincidental neighbor of the above IP:

213.186.120.196.utel.net.ua
Mozilla/5.0 (compatible; SiteBot/0.1; +http://www.sitebot.org/robot/)

robots.txt? Yes...

But don't let that fool you. See even more comments about 213.186.120.196 [projecthoneypot.org...] a la:

"They claim to be sitebot. Don't ask, just block it. And all other IPs of Ukraine. This is another attempt to "fool webmasters", by giving a "search engine bot" user agent. The main goal is to spam, of course, but I would be surprised if they could not deliver malware as well (SQL.injection and the like)."

(I've redirected .ua for years. Never once had a real person touch base after the fact.)

frontpage

4:22 pm on Aug 18, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just got hit by the same bot today from the same IP above:

Agent: Mozilla/5.0 (compatible; AhrefsBot/1.0; +http://ahrefs . com/robot/)


No request for robots.txt found.

dstiles

7:35 pm on Aug 18, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Been blocking sitebot for a long time on 213.186.122.2 and 213.186.122.3. I'm sure I've seen its alter-ego UA as well,

I block the IP range 213.186.96.0 - 213.186.127.255.

keyplyr

8:55 pm on Aug 18, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



My notes from a couple months ago:

deny from 213.186.96.0/19 #various bad bots at DataCenter, Ukraine (213.186.96.0 - 213.186.127.255)

Staffa

4:57 pm on Aug 21, 2011 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I just had a visit from the OP bot looking for a specific range of URLs, it didn't get anything for I GeoIP block everything that I don't want.

However, these URLs were posted on a forum website over a span of 4 years which would suggest that the bot ripped through that whole site. I feel sorry for the owner, what a waste.