<![CDATA[#DuckDuckFedi: what's a good S3 storage backend that is lightweight enough to not be a pile of overhead for small deployments, but also scales for larger deployments?]]>: what's a good S3 storage backend that is lightweight enough to not be a pile of overhead for small deployments, but also scales for larger deployments?

MinIO took their repo offline again recently and I'm looking for alternatives.

things I came across or already knew:
- SeaweedFS (small single go binary)
- Garage (seems overkill for this but unsure if it actually is that heavy)
- RustFS (neat MinIO replacement, but very new, unsure if mature enough)
- Ceph (definitely overkill)

]]>https://board.circlewithadot.net/topic/517e94bb-a7df-46a8-a27b-b477a4534fe2/duckduckfedi-what-s-a-good-s3-storage-backend-that-is-lightweight-enough-to-not-be-a-pile-of-overhead-for-small-deployments-but-also-scales-for-larger-deploymentsRSS for NodeFri, 15 May 2026 00:37:05 GMTThu, 30 Apr 2026 20:06:52 GMT60<![CDATA[Reply to #DuckDuckFedi: what's a good S3 storage backend that is lightweight enough to not be a pile of overhead for small deployments, but also scales for larger deployments? on Fri, 01 May 2026 10:14:02 GMT]]>@ace that is definitely very good to know, I'm definitely looking for reliable storage here 😅 but also interesting because it feels almost like all that would need is a good wrapper to keep track of and manage the shard redundacy

]]>https://board.circlewithadot.net/post/https://mastodon.derg.nz/users/anthropy/statuses/116498788697339697https://board.circlewithadot.net/post/https://mastodon.derg.nz/users/anthropy/statuses/116498788697339697Fri, 01 May 2026 10:14:02 GMT<![CDATA[Reply to #DuckDuckFedi: what's a good S3 storage backend that is lightweight enough to not be a pile of overhead for small deployments, but also scales for larger deployments? on Fri, 01 May 2026 07:28:41 GMT]]>@anthropy SeaweedFS does work remarkably well, and it has some amazingly low system requirements too.
But I've had multiple times where I've lost EC shards when not running the rebalance and rebuild regularly enough, so I'd recommend sticking to replicated storage for where the data is actually important.

]]>https://board.circlewithadot.net/post/https://toots.ananace.dev/users/ace/statuses/116498138497570621https://board.circlewithadot.net/post/https://toots.ananace.dev/users/ace/statuses/116498138497570621Fri, 01 May 2026 07:28:41 GMT<![CDATA[Reply to #DuckDuckFedi: what's a good S3 storage backend that is lightweight enough to not be a pile of overhead for small deployments, but also scales for larger deployments? on Thu, 30 Apr 2026 20:08:55 GMT]]>@anthropy I've been playing around with Garage and it works okay for me. Not amazingly easy to auto-deploy on e.g. Docker as it needs some commands running to configure it.
My use case is a bunch of workers orbiting an API pulling work from S3/API and putting the results on S3.

]]>https://board.circlewithadot.net/post/https://digipres.club/users/philpem/statuses/116495465560673973https://board.circlewithadot.net/post/https://digipres.club/users/philpem/statuses/116495465560673973Thu, 30 Apr 2026 20:08:55 GMT