Pleased to share a page and explainer for the AI tarpit project Science is Poetry, with legal statement, rationale(s), and a few deployment notes:
-
@JulianOliver do you want some subdomains on https://nein.wtf? feel free to pick!
-
I've started to harvest a list of AI crawler endpoint addrs for your blacklisting pleasure.
I'll try to keep it updated. I've been fastidious with ensuring I'm only pulling those related to the known user agent, so as not to have any false positives
https://scienceispoetry.net/files/parasites.txt
It is at the same path for all contributed domains.
For instance:
It's approaching DoS at this point. This just one of the VMs, and just OpenAI's parasite.
Threading's holding up but need some more tuning of rate limits and burst. Trying sending 429's now to ask them to play nice.
To think the www was built for people.
And here we are
-
@JulianOliver they are, A and AAAA records already set up
-
@JulianOliver they are, A and AAAA records already set up
@computersandblues Ahh, so good. I'll add them first thing tomorrow. It's evening here. Will let you know as soon as I do
-
@dch I would think they would still try the bare/apex domain and "www".
@JulianOliver@pertho in my experience it seems they don’t even bother with wildcard domains @JulianOliver
-
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
@JulianOliver I have a slew of currently un -used domains. Where do I point them?
-
@JulianOliver I have a slew of currently un -used domains. Where do I point them?
@WTL Thanks! Just these two records:
A: 95.216.76.85
AAAA: 2a01:4f9:2b:c83::2 -
I've started to harvest a list of AI crawler endpoint addrs for your blacklisting pleasure.
I'll try to keep it updated. I've been fastidious with ensuring I'm only pulling those related to the known user agent, so as not to have any false positives
https://scienceispoetry.net/files/parasites.txt
It is at the same path for all contributed domains.
For instance:
Hi @JulianOliver,
mind adding a parallel https://cdb.cr.yp.to file? -
It's approaching DoS at this point. This just one of the VMs, and just OpenAI's parasite.
Threading's holding up but need some more tuning of rate limits and burst. Trying sending 429's now to ask them to play nice.
To think the www was built for people.
And here we are
Hi @JulianOliver,
indeed an act of #hygiene blocking #bots: https://doi.org/10.17487/RFC8890 "The Internet is for End Users" -
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
You can add `dreckiger.schleimpilz.ch` to the list. Thanks for all your work!
-
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
@JulianOliver I have a handful of domains that I would love to see used for tarpitting.
-
@JulianOliver @pertho yes this is the thing. you can get hold of live streams of newly created TLS certificates, an example https://bencevans.io/security/certificate-stream
@JulianOliver @pertho hopefully there are no longer any newly deployed web services that sit around waiting for setup, with default credentials, or no auth at all...
-
@pertho in my experience it seems they don’t even bother with wildcard domains @JulianOliver
@dch This is very good to know!
@JulianOliver -
@JulianOliver I have a domain I could donate
-
Thanks for all the domain donations, a beautiful thing!
Listed on the landing page:
And copied into this post:
https://carrot.mro1.de
https://car.rot.mro1.de
https://ca.rr.ot.mro1.de
https://sygrovelaw.co.nz
https://wholesaletechnology.co.nz
https://goldenageproductions.co.nz
https://kginno.eu
https://outgoing.nz
https://unbreak.nz
https://poetry.rainskit.com
https://poetry.narthur.com
https://madhattercorp.com
https://sustainable-collective.org
https://sustainable-collective.de
https://c0-cloud.dei have a couple domains i can donate. how does it work?
-
i have a couple domains i can donate. how does it work?
@pumiquxt Thanks a lot for stepping up! You just need to log into your domain manager and add these two records:
A: 95.216.76.85
AAAA: 2a01:4f9:2b:c83::2 -
@JulianOliver I have a domain I could donate
@smn Thank you! Here are the records that are needed:
A: 95.216.76.85
AAAA: 2a01:4f9:2b:c83::2 -
@JulianOliver I have a handful of domains that I would love to see used for tarpitting.
-
@falken Excellent! Might you tell me the domain? I will then add it the TLS chain and to the site config. You can let me know by DM if you'd prefer.
-
Do you have an unused domain that you would be happy to donate to a counter-offensive against unchecked & unregulated AI crawlers that scrape human-made content to simulate & deceive for profit?
If so, pls reply to this post. Your domain would become an entrypoint to the AI tarpit & Poison-as-a-Service project below, allowing concerned public to choose to use it on their sites, helping make the project more resilient to blacklisting.
@JulianOliver hi just catching up to this! pointed sales.luddite.academy at the IPs
