Fun #Codeberg fact.
-
Fun #Codeberg fact.
Add /!~codeberger~!/ to the end of any Codeberg URL and you will get their AI scraper garbage loop page!
-
@mrmasterkeyboard I did not know that 🤩
-
@mrmasterkeyboard I have something similar, with random golang docs where all the AI crawlers end up eventually. Great source of IPs https://code.asyncmachine.dev/pkg/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc/internal/otlpconfig.html
-
M mrmasterkeyboard@mastodon.social shared this topic
-
@mrmasterkeyboard I have something similar, with random golang docs where all the AI crawlers end up eventually. Great source of IPs https://code.asyncmachine.dev/pkg/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc/internal/otlpconfig.html
@pancsta ooh, nice!
-
@mrmasterkeyboard Yeah, take that slop scrapers.
Based Codeberg. -
@mrmasterkeyboard I have something similar, with random golang docs where all the AI crawlers end up eventually. Great source of IPs https://code.asyncmachine.dev/pkg/go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc/internal/otlpconfig.html
@pancsta @mrmasterkeyboard feel free to conttibute to the public blocklist list I maintain.
https://github.com/greyhat-academy/lists.d/blob/main/scrapers.ipv4.block.list.tsv
