Got a strange web-hit today - Crawler, Spider, and User Agent ID forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

Got a strange web-hit today

GladysAction/1108 CFNetwork/1402.0.8 Darwin/22.2.0

SumGuy

11:45 pm on Jan 3, 2023 (gmt 0)

Top Contributors Of The Month

Got a strange web-hit today. IP was 98.45.185.29 (Comcast, maybe somewhere in California). Hit to my landing page, user-agent was

Mozilla/5.0 (iPhone; CPU iPhone OS 16_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.2 Mobile/15E148 Safari/604.1

Doesn't seem to have had a referrer. Hit was direct to https. Landing page fully rendered (all the right files requested). No browsing was done.

A second later (all of this is the same IP) another hit to the landing page, this time the user-agent is

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.4 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.4 facebookexternalhit/1.1 Facebot Twitterbot/1.0

Just the landing page html file requested, no other files, except this:

/apple-touch-icon-precomposed.png

But user-agent for that request was

com.apple.WebKit.Networking/8614.3.7.0.6 CFNetwork/1402.0.8 Darwin/22.2.0

That happened twice. Then, 10 seconds later, a HEAD to my landing page file, this time the user-agent is:

GladysAction/1108 CFNetwork/1402.0.8 Darwin/22.2.0

Right after that, the file was requested (GET) along with favicon.ico, both with the same "gladysaction" user-agent.

Then they're gone.

I can find nothing on the web about "GladysAction". Alone, or part of a UA.

blend27

8:14 am on Jan 4, 2023 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Top Contributors Of The Month

Sam, Are you positively sure that Gladys is not after You?, like twice?

Looks like there is a hangout at CFNetwork where she(it - if not careful) could had met Darvin, "favicon action" sharing type, where....HEAD...and they like landing pages...and they call themselves Users of Agents and don't just do browsing ...

;)

[developer.apple.com...]

Pfui

6:38 pm on Jan 13, 2023 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Top Contributors Of The Month

I can't speak to having seen Gladys, but "facebookexternalhit/1.1 Facebot Twitterbot/1.0" shows up when people text a link in Apple's iMessage app. The linked page's html and the site's apple-touch-icon-precomposed.png are retrieved. Subsequent frequency depends on how often the iMessage user opens/uses that particular conversation, tapering over time as the message scrolls up.

FWIW: "Intel Mac OS X 10_11_1", a.k.a. v10.11.1, is ollld. I still use it on my desktop so I can run old programs but I redirect others. OS X is up to 10.16.x now.)

lucy24

9:09 pm on Jan 13, 2023 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Top Contributors Of The Month

OS X is up to 10.16.x now.

Mine just updated from 13.0 to 13.1 (desktop last night, laptop this morning). On my previous computer you had to pay for system upgrades, but this time around they just keep hurling them at me: 10.12, .13, .14, up to 10.15 I think, and then they remembered that you can count past ten: 11, 12, 13 so far. Go figure. (And yes, my desktop is an intel, I think from the very last batch they made.)

There are plenty of reasons for people to stick with an older OS. Older browsers, not so much, unless the computer itself is too old.

Pfui

1:23 am on Jan 14, 2023 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Top Contributors Of The Month

Mactalk aside to Lucy: You're a Mac person, too? FWIW redux: On my old desktop (10.13.6), Safari stopped letting me update in 2020 (stuck at 13.1.2). Firefox is still going strong (108.0.2), updating almost all too often. (I wouldn't use Chrome even if you paid me.) All other Apple devices are religiously up to date.

blend27

3:11 pm on Jan 16, 2023 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Top Contributors Of The Month

I personally block/return blank page to anything that has no balanced parentheses in UA, unless it is white-listed and not .ico, *icons/favicon-*.png and occasional LOGO Image.

So I did a little research on the site logs that is about a year old or so, not so busy:

SELECT DISTINCT (CONVERT(varchar(10), usageCount) + '----' +user_agent_string) as usageCountDarwin,usageCount
FROM distinct_user_agents
WHERE (user_agent_string LIKE '%Darwin%')
ORDER BY usageCount DESC

Records for Distinct user-agents and their usage count that request .ico, *icons/favicon-*.png and occasional LOGO Image:

usageCountDarwin
29----MobileSafari/8614.1.25.0.30 CFNetwork/1390 Darwin/22.0.0
26----MobileSafari/8614.1.25.0.31 CFNetwork/1390 Darwin/22.0.0
24----MobileSafari/8614.2.9.0.10 CFNetwork/1399 Darwin/22.1.0
16----com.apple.WebKit.Networking/8614.2.9.0.10 CFNetwork/1399 Darwin/22.1.0
16----MobileSafari/8613.2.7.0.7 CFNetwork/1333.0.4 Darwin/21.5.0
14----com.apple.WebKit.Networking/8614.1.25.0.30 CFNetwork/1390 Darwin/22.0.0
14----MobileSafari/8613.3.9.0.16 CFNetwork/1335.0.3 Darwin/21.6.0
13----com.apple.WebKit.Networking/8614.1.25.0.31 CFNetwork/1390 Darwin/22.0.0
12----MobileSafari/8614.2.9.0.11 CFNetwork/1399 Darwin/22.1.0
10----Safari/16613.1.17.1.13 CFNetwork/1240.0.4 Darwin/20.6.0
9----Viber/18.2.1.11 CFNetwork/1335.0.3 Darwin/21.6.0
7----MobileSafari/8614.3.7.0.6 CFNetwork/1402.0.8 Darwin/22.2.0
7----Viber/18.3.0.22 CFNetwork/1335.0.3 Darwin/21.6.0
6----App/0.0.1 CFNetwork/711.1.16 Darwin/14.0.0
6----MobileSafari/8613.3.9.0.5 CFNetwork/1335.0.3 Darwin/21.6.0
5----com.apple.WebKit.Networking/8614.2.9.0.11 CFNetwork/1399 Darwin/22.1.0
5----com.apple.WebKit.Networking/8614.3.7.0.6 CFNetwork/1402.0.8 Darwin/22.2.0
5----MobileSafari/604.1 CFNetwork/1240.0.4 Darwin/20.6.0
5----Viber/18.1.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
5----Viber/18.2.1.11 CFNetwork/1333.0.4 Darwin/21.5.0
4----Viber/18.2.1.11 CFNetwork/1331.0.7 Darwin/21.4.0
4----Viber/18.3.0.22 CFNetwork/1333.0.4 Darwin/21.5.0
4----Viber/18.4.1.1 CFNetwork/1335.0.3 Darwin/21.6.0
3----MobileSafari/8612.2.9.0.20 CFNetwork/1325.0.1 Darwin/21.1.0
3----MobileSafari/8612.3.6.0.4 CFNetwork/1327.0.4 Darwin/21.2.0
3----Safari/17614.1.25.9.10 CFNetwork/1335.0.3 Darwin/21.6.0
3----Safari/18614.2.9.1.12 CFNetwork/1399.4 Darwin/22.1.0
3----Viber/17.9.0.3 CFNetwork/1335.0.3 Darwin/21.6.0
3----Viber/18.0.0.1 CFNetwork/1333.0.4 Darwin/21.5.0
3----Viber/18.0.1.286 CFNetwork/1331.0.7 Darwin/21.4.0
3----Viber/18.1.0.1 CFNetwork/1333.0.4 Darwin/21.5.0
3----Viber/18.2.1.11 CFNetwork/1329 Darwin/21.3.0
3----Viber/18.4.2.2 CFNetwork/1390 Darwin/22.0.0
3----Viber/18.5.1.2 CFNetwork/1390 Darwin/22.0.0
3----Viber/18.5.2.201 CFNetwork/1335.0.3 Darwin/21.6.0
3----Viber/18.8.0.11 CFNetwork/1390 Darwin/22.0.0
3----Viber/18.9.0.13 CFNetwork/1399 Darwin/22.1.0
2----Client/19787 CFNetwork/1335.0.3 Darwin/21.6.0
2----Client/21907 CFNetwork/1390 Darwin/22.0.0
2----Client/24234 CFNetwork/1335.0.3 Darwin/21.6.0
2----MobileSafari/604.1 CFNetwork/1240.0.4 Darwin/20.5.0
2----MobileSafari/8613.4.1.0.2 CFNetwork/1335.0.3 Darwin/21.6.0
2----MobileSafari/8614.1.14.0.14 CFNetwork/1378.1 Darwin/22.0.0
2----NotificationServiceExtension/18.2.1.11 CFNetwork/1335.0.3 Darwin/21.6.0
2----Safari/17613.3.9.1.16 CFNetwork/1335.0.3 Darwin/21.6.0
2----Safari/17613.3.9.1.5 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/17.2.0.1 CFNetwork/1329 Darwin/21.3.0
2----Viber/17.6.1.1 CFNetwork/1333.0.4 Darwin/21.5.0
2----Viber/17.8.1.2 CFNetwork/1327.0.4 Darwin/21.2.0
2----Viber/17.8.1.2 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.0.1.286 CFNetwork/1240.0.4 Darwin/20.6.0
2----Viber/18.0.1.286 CFNetwork/1333.0.4 Darwin/21.5.0
2----Viber/18.0.1.286 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.1.0.1 CFNetwork/978.0.7 Darwin/18.7.0
2----Viber/18.2.1.11 CFNetwork/1240.0.4 Darwin/20.6.0
2----Viber/18.2.1.11 CFNetwork/1312 Darwin/21.0.0
2----Viber/18.2.1.11 CFNetwork/1325.0.1 Darwin/21.1.0
2----Viber/18.2.1.11 CFNetwork/1327.0.4 Darwin/21.2.0
2----Viber/18.3.0.22 CFNetwork/1331.0.7 Darwin/21.4.0
2----Viber/18.3.0.22 CFNetwork/1390 Darwin/22.0.0
2----Viber/18.4.2.2 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.5.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.5.1.2 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.5.2.201 CFNetwork/1390 Darwin/22.0.0
2----Viber/18.6.0.7 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.6.0.7 CFNetwork/1390 Darwin/22.0.0
2----Viber/18.7.0.10 CFNetwork/1335.0.3 Darwin/21.6.0
2----Viber/18.7.0.10 CFNetwork/1390 Darwin/22.0.0
1----Client/15076 CFNetwork/1335.0.3 Darwin/21.6.0
1----Client/16952 CFNetwork/1335.0.3 Darwin/21.6.0
1----Client/17705 CFNetwork/1240.0.4 Darwin/20.5.0
1----Client/22549 CFNetwork/1390 Darwin/22.0.0
1----Client/23855 CFNetwork/1390 Darwin/22.0.0
1----Client/24234 CFNetwork/1220.1 Darwin/20.3.0
1----Client/24234 CFNetwork/1390 Darwin/22.0.0
1----Client/24234 CFNetwork/1399 Darwin/22.1.0
1----com.apple.WebKit.Networking/8614.1.19.0.4 CFNetwork/1385 Darwin/22.0.0
1----com.apple.WebKit.Networking/8614.1.25.0.11 CFNetwork/1390 Darwin/22.0.0
1----Google/236.0.484392333 CFNetwork/1329 Darwin/21.3.0
1----Google/236.0.484392333 CFNetwork/1399 Darwin/22.1.0
1----Google/238.1.487893381 CFNetwork/1240.0.4 Darwin/20.6.0
1----Google/238.1.487893381 CFNetwork/1399 Darwin/22.1.0
1----Google/242.1.493995244 CFNetwork/1399 Darwin/22.1.0
1----MobileSafari/604.1 CFNetwork/1121.2.2 Darwin/19.2.0
1----MobileSafari/604.1 CFNetwork/1121.2.2 Darwin/19.3.0
1----MobileSafari/8614.1.25.0.11 CFNetwork/1390 Darwin/22.0.0
1----MobileSafari/8614.1.25.0.17 CFNetwork/1390 Darwin/22.0.0
1----MobileSafari/8614.2.1 CFNetwork/1390 Darwin/22.1.0
1----MobileSafari/8614.3.7.0.5 CFNetwork/1402.0.8 Darwin/22.2.0
1----NotificationServiceExtension/18.2.1.11 CFNetwork/1331.0.7 Darwin/21.4.0
1----NotificationServiceExtension/18.2.1.11 CFNetwork/1333.0.4 Darwin/21.5.0
1----NotificationServiceExtension/18.8.0.11 CFNetwork/1335.0.3 Darwin/21.6.0
1----NotificationServiceExtension/18.9.0.13 CFNetwork/1399 Darwin/22.1.0
1----Opera/3 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/10.8.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/11.7.0.1 CFNetwork/1240.0.4 Darwin/20.5.0
1----Viber/13.5.0.5 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/14.4.0.1 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/14.4.2.8 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/14.9.0.1 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/15.2.1.6 CFNetwork/1209 Darwin/20.2.0
1----Viber/15.3.0.7 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/15.3.0.7 CFNetwork/1390 Darwin/22.0.0
1----Viber/15.5.5.287 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/15.7.1.13 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/15.9.0.1 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/15.9.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/15.9.0.1 CFNetwork/978.0.7 Darwin/18.7.0
1----Viber/16.0.1.172 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/16.3.2.20 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/16.3.2.20 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/16.4.1.11 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/16.6.0.1 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/16.6.1.91 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/16.6.1.91 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/16.7.3.1 CFNetwork/1327.0.4 Darwin/21.2.0
1----Viber/16.8.1.49 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/16.8.1.49 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/16.9.0.1 CFNetwork/1197 Darwin/20.0.0
1----Viber/16.9.0.1 CFNetwork/1220.1 Darwin/20.3.0
1----Viber/17.0.1.76 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/17.1.0.1 CFNetwork/1329 Darwin/21.3.0
1----Viber/17.2.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/17.4.0.1 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/17.4.0.1 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/17.4.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/17.5.0.1 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/17.5.0.1 CFNetwork/1329 Darwin/21.3.0
1----Viber/17.5.0.1 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/17.5.0.1 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/17.5.0.1 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/17.6.0.4 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/17.6.1.1 CFNetwork/1121.2.2 Darwin/19.3.0
1----Viber/17.6.1.1 CFNetwork/1220.1 Darwin/20.3.0
1----Viber/17.6.1.1 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/17.6.1.1 CFNetwork/1390 Darwin/22.0.0
1----Viber/17.7.0.17 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/17.8.1.2 CFNetwork/1329 Darwin/21.3.0
1----Viber/17.8.1.2 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/17.8.1.2 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/17.8.1.2 CFNetwork/1390 Darwin/22.0.0
1----Viber/17.9.0.3 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/18.0.0.1 CFNetwork/1329 Darwin/21.3.0
1----Viber/18.0.1.286 CFNetwork/1128.0.1 Darwin/19.6.0
1----Viber/18.1.0.1 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/18.1.0.1 CFNetwork/1327.0.4 Darwin/21.2.0
1----Viber/18.1.0.1 CFNetwork/976 Darwin/18.2.0
1----Viber/18.2.1.11 CFNetwork/1206 Darwin/20.1.0
1----Viber/18.2.1.11 CFNetwork/1220.1 Darwin/20.3.0
1----Viber/18.2.1.11 CFNetwork/1240.0.4 Darwin/20.5.0
1----Viber/18.2.1.11 CFNetwork/1388 Darwin/22.0.0
1----Viber/18.2.1.11 CFNetwork/1390 Darwin/22.0.0
1----Viber/18.3.0.22 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/18.3.0.22 CFNetwork/1325.0.1 Darwin/21.1.0
1----Viber/18.3.0.22 CFNetwork/1329 Darwin/21.3.0
1----Viber/18.4.2.2 CFNetwork/1206 Darwin/20.1.0
1----Viber/18.4.2.2 CFNetwork/1240.0.4 Darwin/20.5.0
1----Viber/18.4.2.2 CFNetwork/1240.0.4 Darwin/20.6.0
1----Viber/18.4.2.2 CFNetwork/1312 Darwin/21.0.0
1----Viber/18.5.0.1 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/18.5.0.1 CFNetwork/1390 Darwin/22.0.0
1----Viber/18.5.1.2 CFNetwork/1312 Darwin/21.0.0
1----Viber/18.5.2.201 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/18.6.0.7 CFNetwork/1331.0.7 Darwin/21.4.0
1----Viber/18.7.0.10 CFNetwork/1325.0.1 Darwin/21.1.0
1----Viber/18.8.0.11 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/18.8.0.11 CFNetwork/1335.0.3 Darwin/21.6.0
1----Viber/18.9.0.13 CFNetwork/1333.0.4 Darwin/21.5.0
1----Viber/18.9.0.13 CFNetwork/1390 Darwin/22.0.0
1----Viber/19.0.0.14 CFNetwork/1390 Darwin/22.0.0
1----Viber/19.0.0.14 CFNetwork/1399 Darwin/22.1.0
1----Viber/19.1.0.15 CFNetwork/1390 Darwin/22.0.0
1----Viber/19.1.2.3 CFNetwork/1390 Darwin/22.0.0
1----Viber/19.1.2.3 CFNetwork/1399 Darwin/22.1.0

and no Action for Gladys, I guess Darwin does not want to visit all the attractions on this site.....