<![CDATA[https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/]]>
Link Preview Image
Was my $48K GPU server worth it?

In 2024 I quit my FAANG job to become an independent researcher. To do this I needed GPUs, so I built "grumbl", a 6x 6000 Ada GPU server. This blog describes the build, some of the issues I faced, and answers the question "was it worth it to build the server myself, or should I…

favicon

Rosmine ML Blog (rosmine.ai)

"help I quit my FAANG job and then spent 50k USD on GPUs someone help me with finances my family is starving"

]]>https://board.circlewithadot.net/topic/94dabae7-e045-488d-8853-1d469df576f8/https-rosmine.ai-2026-05-13-was-my-48k-gpu-worth-itRSS for NodeMon, 25 May 2026 17:40:25 GMTThu, 21 May 2026 20:12:14 GMT60<![CDATA[Reply to https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/ on Thu, 21 May 2026 20:22:53 GMT]]>@cwebber@social.coop the motherboard isn't really the expensive part is it?

Source: person who buys the cheapest motherboard possible for his builds

]]>https://board.circlewithadot.net/post/https://activitypub.space/post/1930https://board.circlewithadot.net/post/https://activitypub.space/post/1930Thu, 21 May 2026 20:22:53 GMT<![CDATA[Reply to https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/ on Thu, 21 May 2026 20:22:12 GMT]]>@cwebber lol: “… I ended up moving grumbl to my parents’ basement, where I could upgrade the circuits anyway.”

]]>https://board.circlewithadot.net/post/https://timeloop.cafe/users/bunnyhero/statuses/116614426290064445https://board.circlewithadot.net/post/https://timeloop.cafe/users/bunnyhero/statuses/116614426290064445Thu, 21 May 2026 20:22:12 GMT<![CDATA[Reply to https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/ on Thu, 21 May 2026 20:21:23 GMT]]>@cwebber “Ironically, after designing the entire build around apartment power constraints, I ended up moving grumbl to my parents’ basement, where I could upgrade the circuits anyway.”

Between this dumbass and the one that sunk his cyber truck in a lake in purpose to test its wade mode, I’m convinced God gives too much money to utter jackasses and I don’t know why.

]]>https://board.circlewithadot.net/post/https://lile.cl/users/adriano/statuses/116614423088234759https://board.circlewithadot.net/post/https://lile.cl/users/adriano/statuses/116614423088234759Thu, 21 May 2026 20:21:23 GMT<![CDATA[Reply to https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/ on Thu, 21 May 2026 20:21:04 GMT]]>@cwebber The last GPU I bought was a GTX 1060 back in 2017. How many AIs can I run on that?

]]>https://board.circlewithadot.net/post/https://m29.us/users/ryan/statuses/116614421856834835https://board.circlewithadot.net/post/https://m29.us/users/ryan/statuses/116614421856834835Thu, 21 May 2026 20:21:04 GMT<![CDATA[Reply to https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/ on Thu, 21 May 2026 20:15:10 GMT]]>@cwebber Would you send a DM?

]]>https://board.circlewithadot.net/post/https://lgbtqia.space/ap/users/116601153156461711/statuses/116614398652937806https://board.circlewithadot.net/post/https://lgbtqia.space/ap/users/116601153156461711/statuses/116614398652937806Thu, 21 May 2026 20:15:10 GMT<![CDATA[Reply to https://rosmine.ai/2026/05/13/was-my-48k-gpu-worth-it/ on Thu, 21 May 2026 20:14:43 GMT]]>> Because of this I got a motherboard with slow GPU interconnect. It’s good for running many small experiments in parallel (which is my main use case) but horrible for any models split across gpus.

You spent $50k and your thing can't even actually make proper use of the GPUs you spent an approximate average US person's salary on?

]]>https://board.circlewithadot.net/post/https://social.coop/users/cwebber/statuses/116614396871422283https://board.circlewithadot.net/post/https://social.coop/users/cwebber/statuses/116614396871422283Thu, 21 May 2026 20:14:43 GMT