Pleased to share a page and explainer for the AI tarpit project Science is Poetry, with legal statement, rationale(s), and a few deployment notes:
-
I've started to harvest a list of AI crawler endpoint addrs for your blacklisting pleasure.
I'll try to keep it updated. I've been fastidious with ensuring I'm only pulling those related to the known user agent, so as not to have any false positives
https://scienceispoetry.net/files/parasites.txt
It is at the same path for all contributed domains.
For instance:
Hi @JulianOliver,
mind adding a parallel https://cdb.cr.yp.to file? -
It's approaching DoS at this point. This just one of the VMs, and just OpenAI's parasite.
Threading's holding up but need some more tuning of rate limits and burst. Trying sending 429's now to ask them to play nice.
To think the www was built for people.
And here we are
Hi @JulianOliver,
indeed an act of #hygiene blocking #bots: https://doi.org/10.17487/RFC8890 "The Internet is for End Users" -
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
You can add `dreckiger.schleimpilz.ch` to the list. Thanks for all your work!
-
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
@JulianOliver I have a handful of domains that I would love to see used for tarpitting.
-
@JulianOliver @pertho yes this is the thing. you can get hold of live streams of newly created TLS certificates, an example https://bencevans.io/security/certificate-stream
@JulianOliver @pertho hopefully there are no longer any newly deployed web services that sit around waiting for setup, with default credentials, or no auth at all...
-
@pertho in my experience it seems they don’t even bother with wildcard domains @JulianOliver
@dch This is very good to know!
@JulianOliver -
@JulianOliver I have a domain I could donate
-
Thanks for all the domain donations, a beautiful thing!
Listed on the landing page:
And copied into this post:
https://carrot.mro1.de
https://car.rot.mro1.de
https://ca.rr.ot.mro1.de
https://sygrovelaw.co.nz
https://wholesaletechnology.co.nz
https://goldenageproductions.co.nz
https://kginno.eu
https://outgoing.nz
https://unbreak.nz
https://poetry.rainskit.com
https://poetry.narthur.com
https://madhattercorp.com
https://sustainable-collective.org
https://sustainable-collective.de
https://c0-cloud.dei have a couple domains i can donate. how does it work?
-
i have a couple domains i can donate. how does it work?
@pumiquxt Thanks a lot for stepping up! You just need to log into your domain manager and add these two records:
A: 95.216.76.85
AAAA: 2a01:4f9:2b:c83::2 -
@JulianOliver I have a domain I could donate
@smn Thank you! Here are the records that are needed:
A: 95.216.76.85
AAAA: 2a01:4f9:2b:c83::2 -
@JulianOliver I have a handful of domains that I would love to see used for tarpitting.
-
@falken Excellent! Might you tell me the domain? I will then add it the TLS chain and to the site config. You can let me know by DM if you'd prefer.
-
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
@JulianOliver hi just catching up to this! pointed sales.luddite.academy at the IPs
-
@JulianOliver hi just catching up to this! pointed sales.luddite.academy at the IPs
@diagram_studies Hah, superb. I'll get onto this today. Thanks a lot!
-
@falken Great, on the list for today. ETA 6hrs. Thanks again!
-
@pumiquxt Thanks a lot for stepping up! You just need to log into your domain manager and add these two records:
A: 95.216.76.85
AAAA: 2a01:4f9:2b:c83::2@JulianOliver done. the two domains are:
pumiquxt.art
pumiquxt.us -
It's approaching DoS at this point. This just one of the VMs, and just OpenAI's parasite.
Threading's holding up but need some more tuning of rate limits and burst. Trying sending 429's now to ask them to play nice.
To think the www was built for people.
And here we are
Even faster now.
Again, these pages are randomly generated, and each line is a page request from a crawler.
To think of the energy expended at a global scale, the waste. All the money, water & minerals thrown at this. These AI companies are near DoS'ing the human web as they deep-sea trawl our content.
Computationally, infrastructurally, & culturally, it's an obscenity,
-
Even faster now.
Again, these pages are randomly generated, and each line is a page request from a crawler.
To think of the energy expended at a global scale, the waste. All the money, water & minerals thrown at this. These AI companies are near DoS'ing the human web as they deep-sea trawl our content.
Computationally, infrastructurally, & culturally, it's an obscenity,
@JulianOliver Just gonna set up a fail2ban jail with that list as a log.
-
@JulianOliver Just gonna set up a fail2ban jail with that list as a log.
@ned Sweet, lock the bastards out.
-
@ned Sweet, lock the bastards out.
@JulianOliver Oh I have. Though, I'm seeing a lot less bot traffic since I made the first (hidden) link on my site a link to your tarpit.
