Buried inside this excellent article is a fact that might surprise some:
-
Buried inside this excellent article is a fact that might surprise some:
“If you have thousands or millions of people using [coding models] every single day, the inference costs of just the users generating tons and tons of tokens all the time really outweighs the training side of things.”
The reality of reasoning models is that ongoing inference is even more energy-intensive than the training itself.
But also, yeah, nobody knows how this is getting paid for without a gigantic price hike, and the cost/benefit for a lot of businesses is about to become obviously toxic.
-
Buried inside this excellent article is a fact that might surprise some:
“If you have thousands or millions of people using [coding models] every single day, the inference costs of just the users generating tons and tons of tokens all the time really outweighs the training side of things.”
The reality of reasoning models is that ongoing inference is even more energy-intensive than the training itself.
But also, yeah, nobody knows how this is getting paid for without a gigantic price hike, and the cost/benefit for a lot of businesses is about to become obviously toxic.
-
R relay@relay.infosec.exchange shared this topic
-
Related reporting here: https://www.404media.co/the-ai-compute-crunch-is-here-and-its-affecting-the-entire-economy/
@mttaggart
WelL, thiS IS a sUrPrIsE!No offence to you or your posting.
-
Related reporting here: https://www.404media.co/the-ai-compute-crunch-is-here-and-its-affecting-the-entire-economy/
@mttaggart I don’t see any legacy accounts for sale on eBay, yet. But Reddit has some expected ai .edu resale shenanigans.
-
M mttaggart@infosec.exchange shared this topic
