1. Home
  2. Forums Index
  3. General SEO Issues / Crawler, Spider, and User Agent ID 2:05 am May 21, 2026

Forum Moderators: open

Message Too Old, No Replies

Odd UA acting bad

         

tangor

3:45 am on Aug 13, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



UA: Mozilla/5.0 (Windows NT 6.3; Trident/7.0; rv:11.0) like Gecko
MS Azure
23.101.171.xx
52.240.137.xxx

Aggressive, two days (I was away), ripped entire site multiple times. UA seems "incomplete", at least in my experience.

jmccormac

8:43 am on Aug 13, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Cloud rather than genuine user? Most requests originating from cloud services are problematic at best these days.

Regards...jmcc

lucy24

5:46 pm on Aug 13, 2021 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



:: detour to raw logs ::

I find a fair number of this UA, every last one blocked :)

:: further detour to logged headers ::

Aha. They don't send Accept-Language. That would do it. (Also only the minimalist Accept: */*, used by a number of law-abiding robots but no humans.)
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

  1. Home
  2. Forums Index
  3. General SEO Issues / Crawler, Spider, and User Agent ID 2:05 am May 21, 2026