Why Is Host Europe (HEG) Suddenly Crawling Me?

Forum Moderators: open

Message Too Old, No Replies

Why Is Host Europe (HEG) Suddenly Crawling Me?

RedBar

8:00 pm on Mar 30, 2024 (gmt 0)

Four times in the last couple of weeks to two site, twice to one site this week, every page separately with No Referring Link. Each time they have crawled every page, fortunately they are not large sites, 100-200 pages.

Visits have come from two IPs in Strasbourg, France, but identified as Host Europe (HEG) from Germany.

They have crawled only .co.uk and .uk sites, is this anything to do with the supposed European search engine being created? At the moment I have blocked both full IP ranges.

lucy24

3:30 am on Mar 31, 2024 (gmt 0)

I can't tell from your post: Do they have some visible pretensions to robotitude, such as a name in -bot, -crawler or -spider, or is it a humanoid UA? robots.txt? Pages only, or all supporting files?

SumGuy

11:20 pm on Mar 31, 2024 (gmt 0)

I did something recently with HEG IP's. Either they were already blocked, but trying too many times to get through to my website so they were moved to the total-blocking-list (which I don't log) or they weren't already blocked, but upon new and unwanted website access they were moved to the total blocking list.

But yea, I remember looking up their ASN recently.