Bingbot on 13.66.139.0/24

Forum Moderators: open

Message Too Old, No Replies

Bingbot on 13.66.139.0/24

Seems to have ended?

SumGuy

2:44 am on May 22, 2021 (gmt 0)

For what it's worth, I note that the last regular / daily hit from Bingbot from 13.55.139.0/24 on HTTPS happened on April 21. It also did stop on HTTP on the same day, but I see a pair of hits to the robots file and one specific PDF file on April 29 and May 19. Previously, I'd get about a dozen hits a day from that /24.

lucy24

4:49 am on May 22, 2021 (gmt 0)

Typo .55. for .66., right?

:: detour to logs ::

:: yes, all right, BBEdit, I did mean to say ^13 and not %13 ::

Hm, interesting, I see the same here. Is a month long enough to draw conclusion about Bing's behavior? That's on four different sites, reducing the chance of randomness.

I do see a lone trio of HTTP requests from 13.66 very early on 11 May. Characteristically for bing, it's two robots.txt immediately followed by one page :) All three used HTTP/2, incidentally. HTTP/1 from bingbot seems to be reserved for HTTP. Even robots.txt is almost exclusively requested with HTTP/2, meaning they go straight to the HTTPS side for robots.txt even while continuing to request HTTP URLs in order to gratify their taste for 301s.

lammert

11:57 am on May 22, 2021 (gmt 0)

13.66.139.0/24 is still present here. The last bot action was this morning. I only see 13.66.139.0 and 13.66.139.1 though. All the other IPs from that range seem to have died around April 22.

The xxx.0 and xxx.1 only scratch the surface of my sites. Almost all hits are on robots.txt. The other URLs are not deep URLs but mainly main index files of larger sections of the sites.

jmccormac

12:05 pm on May 22, 2021 (gmt 0)

Think that there was no reverse DNS set up for some of those ranges and they might have been blocked or limited by sites.

Regards...jmcc

wilderness

10:48 am on Aug 1, 2021 (gmt 0)

No clue if verified Bing or not (absent headers).
Bing has been irregular since their inception in 2003.

52.240.159.47 - - [31/Jul/2021:20:57:25 -0700] "GET /robots.txt HTTP/1.1" 200 914 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
52.162.161.148 - - [31/Jul/2021:20:57:57 -0700] "GET /MyFolder/MyPage.html HTTP/1.1" 403 435 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"

lucy24

4:34 pm on Aug 1, 2021 (gmt 0)

Seeing this topic float back to the surface, I re-checked logs. For calendar year 2021 to date, only about 1/200 of bingbot requests from 13.66 have been in the last three months (May through July).

From 52.240 and 52.162 I don't find anything but a handful of malign robots, so I lean toward suspicion.