CIRCLE WITH A DOT

@philpetree @taylorlorenz And can never be faked?

@philpetree @taylorlorenz How does that stop crawlers (and not other traffic)?

@philpetree @taylorlorenz Yes, because LLM crawlers famously respect robots.txt and only use known IP addresses.

@philpetree @taylorlorenz Oh, they're still mining your data. They just use it to train AI instead of dictating what's in your feed.