We Indexed a Petabyte Over a Weekend - by Cliff Crosland of Scanner, Inc.

https://api.cyfluencer.com/s/we-indexed-a-petabyte-over-a-weekend-27004

"Scanner indexed 1.4 PiB of log data across 689 billion events in 80 hours, unattended, at a fraction of what a traditional SIEM would cost. This post breaks down the architecture behind it: how Scanner indexes directly in S3, runs continuous detections in parallel as data streams in, and keeps query latency in seconds across a petabyte of data."