<![CDATA[Is the #LLM race actually a race to the bottom?]]>Is the race actually a race to the bottom? In the short time I've been tracking model development, the jump in what's possible on consumer hardware has been impressive.

Every other week, we see a new model that does more with lighter weights and fewer parameters.

]]>https://board.circlewithadot.net/topic/210c762e-8499-4a0d-bd84-9809fb2b171c/is-the-llm-race-actually-a-race-to-the-bottomRSS for NodeFri, 15 May 2026 04:41:46 GMTThu, 23 Apr 2026 13:58:17 GMT60<![CDATA[Reply to Is the #LLM race actually a race to the bottom? on Thu, 23 Apr 2026 14:19:37 GMT]]>@perpetuum_mobile

Since Gemma4 came out, I agree it's been the gold standard for performance vs compute. If SoC is the way forward for local compute (and I think its clear it is) the real jump happens when unified memory architectures can actually handle the token volume an agentic harness needs.

Progress on memory overhead for long-context agents, combined with advancements in unified pool architecture, make this a real possibility in the near future.

]]>https://board.circlewithadot.net/post/https://mstdn.ca/users/mamba/statuses/116454455867083033https://board.circlewithadot.net/post/https://mstdn.ca/users/mamba/statuses/116454455867083033Thu, 23 Apr 2026 14:19:37 GMT