ugh.
-
@briankrebs @renchap I can objectively say that AI scrapers are a massive problem for me and a drain on resources. Everyone and their dog is trying to scrape the internet continuously with badly designed/vibe coded crawlers that don’t seem to keep track of what they’ve already crawled, let alone the context of what they are attempting to crawl or honoring robots.txt etc
@jerry @briankrebs @renchap Can confirm. They essentially DDoS'd our old website due to how Wordpress handles active lookups with all the effing PHP. Moved to Webflow and our compute dropped way down, partly due to the difference in rendering.
-
@jerry @briankrebs @renchap Can confirm. They essentially DDoS'd our old website due to how Wordpress handles active lookups with all the effing PHP. Moved to Webflow and our compute dropped way down, partly due to the difference in rendering.
@neurovagrant @jerry @briankrebs @renchap
@hrbrmstr knows a lot about this.
-
@briankrebs @renchap I can objectively say that AI scrapers are a massive problem for me and a drain on resources. Everyone and their dog is trying to scrape the internet continuously with badly designed/vibe coded crawlers that don’t seem to keep track of what they’ve already crawled, let alone the context of what they are attempting to crawl or honoring robots.txt etc
@jerry Maybe you already know this, but I heard Iocaine is pretty good blocking scrapers.
https://iocaine.madhouse-project.org/
Don't know if it would work with mastodon. -
ugh. hetzner just announced a pretty significant price increase. I'm going to have to start some serious downsizing before that happens
@jerry Good luck.
I just replaced my old desktop with a new unit. Little mini HP PC. Bought w/ minimal RAM/disk, then bought new RAM separately. The RAM cost 1/2 the price of PC. About $230 for 2 @ 16 GB DDR4 SODIMMs.
Thanks, "AI."
I'm also trying my best to self-host what I can, because 99.9% of what I want to run is just for me/my wife, and I can absolutely get away with it on my limited hardware.
This is truly the worst timeline.
-
@eingfoan They have a detailed page with the pricing changes here: https://docs.hetzner.com/general/infrastructure-and-availability/price-adjustment/
@jerry @eingfoan Phew, looks like StorageShare is not affected at the moment. #NextCloud
-
@jerry @eingfoan Phew, looks like StorageShare is not affected at the moment. #NextCloud
@haraldkliems @eingfoan Hetzner didn't appear to be affected until 8 hours ago. Hopefully it stays that way for you
-
@briankrebs @renchap I can objectively say that AI scrapers are a massive problem for me and a drain on resources. Everyone and their dog is trying to scrape the internet continuously with badly designed/vibe coded crawlers that don’t seem to keep track of what they’ve already crawled, let alone the context of what they are attempting to crawl or honoring robots.txt etc
@jerry @briankrebs @renchap Can confirm: I'm being hit with ~4 requests per second with spikes up to 50 per second lasting hours to days.
It doesn't effect my site (although I still started sending them randomly generated nonsense text), I've seen plenty of great sites get DDoSed off the Internet.
-
@renchap I don't blame Hetzner, and I know they aren't the only ones. It's going to soon impact just about everything else we do online, I am guessing.
-
@jerry I foresee a 25% to 50% price increase in the next 2 years for everything requiring hardware, including servers, cloud but also laptops and phones. This will have a *huge* impact.
-
ugh. hetzner just announced a pretty significant price increase. I'm going to have to start some serious downsizing before that happens
@jerry They didn’t pay more for the RAM you are using. Once there is a reason people accept for price raises, it will be used “ad infinitum”.
-
E em0nm4stodon@infosec.exchange shared this topic
-
@briankrebs @renchap I can objectively say that AI scrapers are a massive problem for me and a drain on resources. Everyone and their dog is trying to scrape the internet continuously with badly designed/vibe coded crawlers that don’t seem to keep track of what they’ve already crawled, let alone the context of what they are attempting to crawl or honoring robots.txt etc
@jerry @briankrebs @renchap @Em0nM4stodon
I distinctly remember the top corporations have companies that protect all their intellect property. It seemed Like a big conglomerate.
