<![CDATA[I'm back to a three-node #Proxmox cluster.]]>I'm back to a three-node cluster. With replications and high availability configured, this setup is my favorite because I can turn off my power-hungry and my critical services will still be online, distributed among the rest of the nodes. Also, this cluster will survive a random single-node failure, so I'll be less worried about the while away.

Price is an additional 10-15 watts of power consumption.

]]>https://board.circlewithadot.net/topic/c797f7d5-4969-4cdf-9de1-cb42a1c9c273/i-m-back-to-a-three-node-proxmox-cluster.RSS for NodeFri, 05 Jun 2026 10:50:05 GMTThu, 28 May 2026 07:33:02 GMT60<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 12:13:10 GMT]]>@yehor
That's not all that slow, you may find it's plenty fast enough for disk I/O. If you have spinning disks you're going to need a lot of them to saturate a gig link.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/FritzAdalis/statuses/116652139543592163https://board.circlewithadot.net/post/https://infosec.exchange/users/FritzAdalis/statuses/116652139543592163Thu, 28 May 2026 12:13:10 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 11:44:23 GMT]]>@FritzAdalis 1 Gbps

]]>https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116652026361267044https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116652026361267044Thu, 28 May 2026 11:44:23 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 10:53:04 GMT]]>@yehor How about a ?

]]>https://board.circlewithadot.net/post/https://vmst.io/users/ErikBussink/statuses/116651824543301851https://board.circlewithadot.net/post/https://vmst.io/users/ErikBussink/statuses/116651824543301851Thu, 28 May 2026 10:53:04 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 10:38:42 GMT]]>@yehor
How slow is your network?

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/FritzAdalis/statuses/116651768066294839https://board.circlewithadot.net/post/https://infosec.exchange/users/FritzAdalis/statuses/116651768066294839Thu, 28 May 2026 10:38:42 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 10:20:18 GMT]]>@alex it’s not for service itself. It’s for virtual guest machines inside Proxmox cluster for seamless migrations and high availability. S3 is not suitable for this.

]]>https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651695729781780https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651695729781780Thu, 28 May 2026 10:20:18 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 09:01:13 GMT]]>@yehor I use S3 solution in most cases if supported by service 🌚

]]>https://board.circlewithadot.net/post/https://masto.ink/users/alex/statuses/116651384739801781https://board.circlewithadot.net/post/https://masto.ink/users/alex/statuses/116651384739801781Thu, 28 May 2026 09:01:13 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 08:57:23 GMT]]>@yehor Yes, that is always a concern. I'm still tweaking my setup, but I've seen that some people use very high replication frequencies (eg, 1 minute, even 30s). But even 1 minute lost would be bad for Matrix.

That said, does Matrix support application-level HA? For example, could you have two instances and fail over from one to the other? In some cases, if the application supports HA that's a better option that doing it via the hypervisor.

]]>https://board.circlewithadot.net/post/https://indieweb.social/users/mjturner/statuses/116651369632888384https://board.circlewithadot.net/post/https://indieweb.social/users/mjturner/statuses/116651369632888384Thu, 28 May 2026 08:57:23 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 08:48:56 GMT]]>@mjturner MoosFS is interesting, thanks!

]]>https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651336424982257https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651336424982257Thu, 28 May 2026 08:48:56 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 08:48:39 GMT]]>@mjturner Well, I'm currently using replication, but my concern is that when the node fails, migrated guets could be as old as the replication period. For example, I'm replicating the Matrix instance every 15 minutes. And if the node with the Matrix server fails, HA will migrate the last replicated copy of it. And for the chat server, going back 15 minutes could not be good.

]]>https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651335306190961https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651335306190961Thu, 28 May 2026 08:48:39 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 08:28:26 GMT]]>@yehor regarding "my network is too slow for ceph"...
My OSD is a 2TB USB Stick and my Network is 1Gbit. It takes nearly a day to rebuild. It saved my ass more than one time. Extend and migrate Storage was never that easy. Ask me in a week how the upgrade to Proxmox 9 was going. πŸ˜‰

]]>https://board.circlewithadot.net/post/https://social.cologne/users/viper539/statuses/116651255817605359https://board.circlewithadot.net/post/https://social.cologne/users/viper539/statuses/116651255817605359Thu, 28 May 2026 08:28:26 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 08:25:40 GMT]]>@yehor Do you need shared storage? replication works very well, even with gigabit Ethernet. It can be a little hard on SSDs but even decent consumer drives should be fine (enterprise drives with PLP are first prize though). It's the option I've gone for with my three node ThinkCentre cluster.

Another option is , which I have heard works well, although you do need to install and manage it outside Proxmox. https://moosefs.com/

]]>https://board.circlewithadot.net/post/https://indieweb.social/users/mjturner/statuses/116651244920168655https://board.circlewithadot.net/post/https://indieweb.social/users/mjturner/statuses/116651244920168655Thu, 28 May 2026 08:25:40 GMT<![CDATA[Reply to I'm back to a three-node #Proxmox cluster. on Thu, 28 May 2026 07:37:53 GMT]]>The only thing my lacks is a shared storage for cluster guest disks, and I still haven't figured out a simple solution for that. Maybe there are none.

is complex and sounds like an overhead.

For / , my network is too slow.

]]>https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651057081966846https://board.circlewithadot.net/post/https://mastodon.glitchy.social/ap/users/115541879940528080/statuses/116651057081966846Thu, 28 May 2026 07:37:53 GMT