Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Cyborg)
  • No Skin
Collapse
Brand Logo

CIRCLE WITH A DOT

  1. Home
  2. Uncategorized
  3. AI bots are now blocked on Sourcefeed.

AI bots are now blocked on Sourcefeed.

Scheduled Pinned Locked Moved Uncategorized
2 Posts 2 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • tg@indieweb.socialT This user is from outside of this forum
    tg@indieweb.socialT This user is from outside of this forum
    tg@indieweb.social
    wrote last edited by
    #1

    AI bots are now blocked on Sourcefeed. Being RSS-only there’s not really much to scrape, so the surface area is small, but now they’re explicitly blocked from the feeds. If they ignore robots.txt there’s still a proxy/middleware that will blackhole them.

    https://www.sourcefeed.app/robots.txt

    alex27@infosec.exchangeA 1 Reply Last reply
    0
    • tg@indieweb.socialT tg@indieweb.social

      AI bots are now blocked on Sourcefeed. Being RSS-only there’s not really much to scrape, so the surface area is small, but now they’re explicitly blocked from the feeds. If they ignore robots.txt there’s still a proxy/middleware that will blackhole them.

      https://www.sourcefeed.app/robots.txt

      alex27@infosec.exchangeA This user is from outside of this forum
      alex27@infosec.exchangeA This user is from outside of this forum
      alex27@infosec.exchange
      wrote last edited by
      #2

      @tg you may like seeing this: https://mastodon.social/@JulianOliver/116424124397637057

      1 Reply Last reply
      1
      0
      • R relay@relay.infosec.exchange shared this topic
      Reply
      • Reply as topic
      Log in to reply
      • Oldest to Newest
      • Newest to Oldest
      • Most Votes


      • Login

      • Login or register to search.
      • First post
        Last post
      0
      • Categories
      • Recent
      • Tags
      • Popular
      • World
      • Users
      • Groups