Forum Moderators: open

TikTokSpider

         

lucy24

9:53 pm on Mar 9, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



New one on me, but it can't possibly be brand-new, can it?

robots.txt: no
IP: 47.128.various
UA: Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Mobile Safari/537.36;TikTokSpider;ttspider-feedback@tiktok.com
UA: Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; TikTokSpider; ttspider-feedback@tiktok.com)

47.128-131 is AWS Singapore (Isn't that where TikTok's founder comes from? Or am I getting my congressional hearings mixed up?) fwiw, ByteSpider comes from the same neighborhood.

Blocked due to header deficits.

I haven't seen it often enough to generalize safely. So far, some-but-not all visits have also requested the supporting files that a human would get with a 403, but never the favicon.

Bewenched

6:50 pm on Mar 14, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



We had a pretty nasty visit from them as well, but they actually totally overloaded our server today.

47.128.121.XX (Canada)3/14/2025 5:01:33 PM/images/products/thumbnails/KCH5205.jpg1.21 KB614206 - Partial Content GEThttps://www.xxxxx.com/xxx/xxx/xxx/page_1.htm Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; TikTokSpider; ttspider-feedback@tiktok.com)

Blocked fast.
never asked for robots.txt

ryoko

6:02 pm on Apr 7, 2025 (gmt 0)

10+ Year Member Top Contributors Of The Month



I've had this one a lot today, from 47.128.121.xx
However, it appeared to grab robots.txt with the user-agent Go-http-client/2.0 for some reason.
Same time and IP address as TikTokSpider.

not2easy

6:31 pm on Apr 7, 2025 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



If you're using IPs for blocking, 47.128. is an Amazon server range:
47.128.0.0 - 47.131.255.255
47.128.0.0/14

lucy24

9:04 pm on Apr 7, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



to grab robots.txt with the user-agent Go-http-client/2.0 for some reason
I wish the next passing botrunner would explain the reason, because 99 times out of 100, giving a different UA just for robots.txt can only be called counterproductive. On my site, a handful of factors--one of them being bad_agent--nets you a generic
User-Agent: *
Disallow: /
where a truthful UA might have won permission to enter.

Brett_Tabke

12:52 pm on Oct 14, 2025 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Still seeing this? Do you post to Tiktok with links? Or can you find links on tiktok?

Reason I ask is that I recently started getting some spiders id'ing as TikTok as well on searchengineworld world. I can only find a couple links on TTK to sew. (one was my link drop. lol)


I don't see anyone else talking about this anywhere.

lucy24

5:52 pm on Oct 14, 2025 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I, personally, have never had any interaction of any kind with TikTok. Pretty sure the Venn diagram of my target audience and TikTok’s target audience is as close to two non-overlapping circles as makes no difference.

:: quick run to raw logs ::

Within the present calendar year, most recently in September, I find an aggregate total of 124 requests. All include supporting files; in blocked requests, that means one small image that appears in the error document. But never the favicon. And no rhyme or reason for the requests--rarely a single image, generally a page--except that I can say with confidence that some of them cannot possibly be of interest to the TikTok demographic. (This is assuming that TikTok, unlike the former Twitter, doesn't have a niche fraction of users who are interested in grownup material. Does Neil DeGrasse Tyson have a TikTok?)