Buried inside this excellent article is a fact that might surprise some:
-
Buried inside this excellent article is a fact that might surprise some:
“If you have thousands or millions of people using [coding models] every single day, the inference costs of just the users generating tons and tons of tokens all the time really outweighs the training side of things.”
The reality of reasoning models is that ongoing inference is even more energy-intensive than the training itself.
But also, yeah, nobody knows how this is getting paid for without a gigantic price hike, and the cost/benefit for a lot of businesses is about to become obviously toxic.
You’re about to feel the AI money squeeze
Leading labs like OpenAI and Anthropic have raised billions from investors to fuel their scaling and compute needs, and users are feeling the effects.
The Verge (www.theverge.com)
-
Buried inside this excellent article is a fact that might surprise some:
“If you have thousands or millions of people using [coding models] every single day, the inference costs of just the users generating tons and tons of tokens all the time really outweighs the training side of things.”
The reality of reasoning models is that ongoing inference is even more energy-intensive than the training itself.
But also, yeah, nobody knows how this is getting paid for without a gigantic price hike, and the cost/benefit for a lot of businesses is about to become obviously toxic.
You’re about to feel the AI money squeeze
Leading labs like OpenAI and Anthropic have raised billions from investors to fuel their scaling and compute needs, and users are feeling the effects.
The Verge (www.theverge.com)
-
R relay@relay.infosec.exchange shared this topic
-
Related reporting here: https://www.404media.co/the-ai-compute-crunch-is-here-and-its-affecting-the-entire-economy/
@mttaggart
WelL, thiS IS a sUrPrIsE!No offence to you or your posting.
-
Related reporting here: https://www.404media.co/the-ai-compute-crunch-is-here-and-its-affecting-the-entire-economy/
@mttaggart I don’t see any legacy accounts for sale on eBay, yet. But Reddit has some expected ai .edu resale shenanigans.
-
M mttaggart@infosec.exchange shared this topic
