<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Interesting read on the way LLM bots retrieve pages from a website]]></title><description><![CDATA[<p>Interesting read on the way LLM bots retrieve pages from a website</p><p>Explanations are clear precise and surgical</p><p></p><div class="card col-md-9 col-lg-6 position-relative link-preview p-0">



<a href="https://surfacedby.com/blog/nginx-logs-ai-traffic-vs-referral-traffic" title="AI traffic vs referral traffic: what nginx logs prove | SurfacedBy">
<img src="https://blog.surfacedby.com/wp-content/uploads/2026/04/nginx-access-log.png" class="card-img-top not-responsive" style="max-height:15rem" alt="Link Preview Image" />
</a>



<div class="card-body">
<h5 class="card-title">
<a href="https://surfacedby.com/blog/nginx-logs-ai-traffic-vs-referral-traffic">
AI traffic vs referral traffic: what nginx logs prove | SurfacedBy
</a>
</h5>
<p class="card-text line-clamp-3">What nginx logs actually prove about AI traffic from ChatGPT, Claude, and Perplexity, plus why Google's AI crawlers leave a different signal than the others.</p>
</div>
<a href="https://surfacedby.com/blog/nginx-logs-ai-traffic-vs-referral-traffic" class="card-footer text-body-secondary small d-flex gap-2 align-items-center lh-2">



<img src="https://surfacedby.com/favicon.ico" alt="favicon" class="not-responsive overflow-hiddden" style="max-width:21px;max-height:21px" />





<p class="d-inline-block text-truncate mb-0">SurfacedBy <span class="text-secondary">(surfacedby.com)</span></p>
</a>
</div> <p></p><p><a href="https://mastodon.bsd.cafe/tags/LLM" rel="tag">#<span>LLM</span></a> <a href="https://mastodon.bsd.cafe/tags/AI" rel="tag">#<span>AI</span></a> <a href="https://mastodon.bsd.cafe/tags/slop" rel="tag">#<span>slop</span></a> <a href="https://mastodon.bsd.cafe/tags/nginx" rel="tag">#<span>nginx</span></a> <a href="https://mastodon.bsd.cafe/tags/traffic" rel="tag">#<span>traffic</span></a> <a href="https://mastodon.bsd.cafe/tags/programming" rel="tag">#<span>programming</span></a> <a href="https://mastodon.bsd.cafe/tags/referral" rel="tag">#<span>referral</span></a> <a href="https://mastodon.bsd.cafe/tags/traffic" rel="tag">#<span>traffic</span></a> <a href="https://mastodon.bsd.cafe/tags/networking" rel="tag">#<span>networking</span></a> <a href="https://mastodon.bsd.cafe/tags/robots" rel="tag">#<span>robots</span></a> <a href="https://mastodon.bsd.cafe/tags/txt" rel="tag">#<span>txt</span></a> <a href="https://mastodon.bsd.cafe/tags/claude" rel="tag">#<span>claude</span></a> <a href="https://mastodon.bsd.cafe/tags/chatgpt" rel="tag">#<span>chatgpt</span></a> <a href="https://mastodon.bsd.cafe/tags/bing" rel="tag">#<span>bing</span></a> <a href="https://mastodon.bsd.cafe/tags/meta" rel="tag">#<span>meta</span></a> <a href="https://mastodon.bsd.cafe/tags/metaAI" rel="tag">#<span>metaAI</span></a></p>]]></description><link>https://board.circlewithadot.net/topic/ebf4e8da-0d8c-4b52-9814-2fecc8ca3cb8/interesting-read-on-the-way-llm-bots-retrieve-pages-from-a-website</link><generator>RSS for Node</generator><lastBuildDate>Fri, 01 May 2026 02:39:47 GMT</lastBuildDate><atom:link href="https://board.circlewithadot.net/topic/ebf4e8da-0d8c-4b52-9814-2fecc8ca3cb8.rss" rel="self" type="application/rss+xml"/><pubDate>Tue, 21 Apr 2026 02:08:31 GMT</pubDate><ttl>60</ttl></channel></rss>