Forum Moderators: open

Message Too Old, No Replies

bot/1.0 (bot; http://; bot@bot.bot)

         

Mokita

11:01 pm on Dec 12, 2006 (gmt 0)

10+ Year Member



I found mention of bot/1.0 here:
[webmasterworld.com...] and here
[webmasterworld.com...]

But mine came from an IP belonging to Charter Communications, 71.13.115.nnn.

It just asked for robots.txt and two pages. It looks ban-worthy to me as they are obviously hiding their intent and identity.

Mokita

4:57 pm on Dec 13, 2006 (gmt 0)

10+ Year Member



This bot is still attempting to crawl the site, despite getting only 403s since I discovered it. It asks for pages at widely spaced intervals, varying from 20 mins to 5 hours.

keyplyr

2:45 am on Dec 15, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It's been sneaking a couple pages each hour. Blocked by UA now.

71.13.115.nn - - [14/Dec/2006:17:21:50 -0500] "GET /robots.txt HTTP/1.0" 200 3588 "-" "bot/1.0 (bot; [;...] bot@bot.bot)"

syntrix

10:24 pm on Dec 22, 2006 (gmt 0)

10+ Year Member



I just blocked this today, and now they are sending these from teh same subnet:

71.13.115.nnn - - [22/Dec/2006:15:15:23 -0800] "-" 408 - "-" "-"

edit: oh wait that's them, just a result of my packet level blocking, duh.

[edited by: volatilegx at 3:33 pm (utc) on Dec. 23, 2006]
[edit reason] obfuscated ip address [/edit]

phi148

12:01 am on Dec 23, 2006 (gmt 0)

10+ Year Member



This bot just jumped on my website as well...

How do you permanently block a bot?

jdMorgan

12:06 am on Dec 23, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Interestingly, this bot has requested robots.txt each time it visited here, found itself disallowed (via "User-agent: *" - "Disallow: /") and has left each time, committing no crime.

Jim

jumpenjuhosaphat

7:41 am on Dec 29, 2006 (gmt 0)

10+ Year Member



I just got a couple of hits from this bot too. Looked a bit suspicious, but doesn't seem to be doing any harm, as it has only accessed my index page and my robots.txt file.