“If you have thousands or millions of people using [coding models] every single day, the inference costs of just the users generating tons and tons of tokens all the time really outweighs the training side of things.”

The reality of reasoning models is that ongoing inference is even more energy-intensive than the training itself.

But also, yeah, nobody knows how this is getting paid for without a gigantic price hike, and the cost/benefit for a lot of businesses is about to become obviously toxic.

https://www.theverge.com/ai-artificial-intelligence/917380/ai-monetization-anthropic-openai-token-economics-revenue