Forum Moderators: open

ShapBot

         

SumGuy

11:55 pm on Nov 13, 2025 (gmt 0)

5+ Year Member Top Contributors Of The Month



I got a couple hits from 136.119.129.236 (google user content) with user-agent:

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36

They got the "I think you're a bot" page (because X11; Linux x86_64). First request was a head, the next was get.

A second later, from same IP, got a head and get for a PDF file. But this time the UA was:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ShapBot/0.1.0

This didn't match any existing rules so they got the file. I've now added 136.119.0.0/16 to my IP blocking, and ShapBot is going into my UA rules.

lucy24

12:17 am on Nov 14, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



:: detour to raw logs ::

Oh, willya look at that.
2742 occurrences of "ShapBot" found in 73 files
Of which:
2742 HEAD
3 (three) robots.txt--this too HEAD, not GET--interestingly, all three of them just yesterday
Response: mostly 429, a handful of 403.

Some from 136.119; plenty more from 104.154.193; others ad lib in The Usual Suspects

Further trip to logged headers tells me the 403 were mostly on grounds of bad_range, though some also had header deficits.

Memo to self: Add ErrorDocument directive for 429, though I don't know if these even reach my userspace.

tangor

3:27 am on Nov 14, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



A game theory* AI bot? Things become more interesting day by day...

*(look it up)