Fun #Codeberg fact.
-
Fun #Codeberg fact.
Add /!~codeberger~!/ to the end of any Codeberg URL and you will get their AI scraper garbage loop page!
-
@mrmasterkeyboard I did not know that 🤩
-
@mrmasterkeyboard I have something similar, with random golang docs where all the AI crawlers end up eventually. Great source of IPs https://code.asyncmachine.dev/pkg/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc/internal/otlpconfig.html
-
M mrmasterkeyboard@mastodon.social shared this topic
-
@mrmasterkeyboard I have something similar, with random golang docs where all the AI crawlers end up eventually. Great source of IPs https://code.asyncmachine.dev/pkg/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc/internal/otlpconfig.html
@pancsta ooh, nice!
-
@mrmasterkeyboard Yeah, take that slop scrapers.
Based Codeberg. -
@mrmasterkeyboard I have something similar, with random golang docs where all the AI crawlers end up eventually. Great source of IPs https://code.asyncmachine.dev/pkg/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc/internal/otlpconfig.html
@pancsta @mrmasterkeyboard feel free to conttibute to the public blocklist list I maintain.
lists.d/scrapers.ipv4.block.list.tsv at main · greyhat-academy/lists.d
List of useful things. Contribute to greyhat-academy/lists.d development by creating an account on GitHub.
GitHub (github.com)
