<![CDATA[Hey #fediadmin.]]>Hey .

Is any one having huge influx of bots scraping /tags/* from Tencent (AS132203), VNPT (AS45899) and some others?

They also scraping media assets, but rps is way lower

]]>https://board.circlewithadot.net/topic/55972c69-9ee8-4328-8a52-5a08f1197930/hey-fediadmin.RSS for NodeThu, 14 May 2026 19:58:47 GMTSun, 19 Apr 2026 14:41:20 GMT60<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 19:29:13 GMT]]>@galaxis uh, okay, trending page is gone as well.

Weird that tags page is still showing basic tag info regardless of the settings

So sad that the only way to stop ruining web is to gatekeep everything

]]>https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116433024017150947https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116433024017150947Sun, 19 Apr 2026 19:29:13 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 19:16:11 GMT]]>@alex ...leaving Trends open unfortunately provides enough fodder for them. On the public instance I help running, users were complaining when we disabled trends though, so adding protection to the media proxy was the easiest way to stop that scraping. On my personal instance, I disabled Trends, so there's nothing left to scrape except my own public posts.

]]>https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432972763951352https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432972763951352Sun, 19 Apr 2026 19:16:11 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 19:11:17 GMT]]>@alex Images are a different problem - it seemed to me (I have not done any deep analysis) that these scrapers act as full user agents, and retrieve posts with all media attachments.

Unfortunately as they progress into older posts or long threads, this causes Mastodon to re-fetch old media. We were plain running out of space, until I dropped in an additional patch that severely rate-limits the media proxy for unauthenticated users, see this other thread: https://mastodon.infra.de/@galaxis/116077343266969640

]]>https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432953501150536https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432953501150536Sun, 19 Apr 2026 19:11:17 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 19:05:43 GMT]]>@galaxis found it! Thank you!

I wonder how long it’s going to take for bots to stop scraping images now.

]]>https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432931616195269https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432931616195269Sun, 19 Apr 2026 19:05:43 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 19:02:11 GMT]]>@alex There's four dropdowns with options in Administration -> Server Settings -> Discovery under the "Public timelines" - header.

]]>https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432917739236724https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432917739236724Sun, 19 Apr 2026 19:02:11 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 18:56:28 GMT]]>@galaxis oh, yeas, this is exactly like this!

By any chance do you remember how to switch federated timeline off for non-authenticated users? I don’t see it in env variable and can’t find anything similar in admin UI.

Thanks!

]]>https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432895216610313https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432895216610313Sun, 19 Apr 2026 18:56:28 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 18:54:11 GMT]]>@alex ...unfortunately it seems like most Mastodon admins don't talk about Mastodon administration much on the Fediverse. I'm aware of a couple of Matrix groups, but other than that I don't know where people are discussing operational details...

]]>https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432886251401942https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432886251401942Sun, 19 Apr 2026 18:54:11 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 18:33:16 GMT]]>@alex See this post for example: https://mastodon.infra.de/@galaxis/115805367424016000

]]>https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432804014822135https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432804014822135Sun, 19 Apr 2026 18:33:16 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 18:31:30 GMT]]>@alex Yes, it's been going on since the end of last year at least.

If I remember correctly, we disabled tags search for unauthenticated users, and then the next thing that was hit was trends. Unfortunately there's no separation between authenticated and unauthenticated clients in the controls for those...

]]>https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432797066683069https://board.circlewithadot.net/post/https://mastodon.infra.de/users/galaxis/statuses/116432797066683069Sun, 19 Apr 2026 18:31:30 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 17:19:45 GMT]]>Oh, great victoria logs integration doesn’t support working with metadata keys.

Seems like it can only parse _msg field, why

]]>https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432514936316524https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432514936316524Sun, 19 Apr 2026 17:19:45 GMT<![CDATA[Reply to Hey #fediadmin. on Sun, 19 Apr 2026 17:00:00 GMT]]>Okay, after adding AS to http logs I can __ 205__ distinct AS numbers in last 30 minutes requesting /tags/*

What the actual fuck?! No, seriously, has anyone seen that? I would suspect fucking AI scrappers, but they only hammering tags endpoint.

]]>https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432437289235232https://board.circlewithadot.net/post/https://feed.yopp.me/users/alex/statuses/116432437289235232Sun, 19 Apr 2026 17:00:00 GMT