CIRCLE WITH A DOT

@MartinEscardo @jonmsterling Indeed you can! I know there's minor caveats, but a lot of modern CPUs and devices have NPUs that are optimized for running neural nets on a low amount of energy. And it does not take much intelligence at all to generate small scripts and searches, although we sometimes need better harnesses for small language models.

@MartinEscardo @jonmsterling I think this might have an implicit bias due to novelty.

The same arguments apply to programming languages, web browsing, operating systems. We could always spend more effort to remove generic platforms and write everything by hand. But this is quite expensive.
The point of a large swathe of computer science is not just algorithms, but how do we build platforms that can automate repetitive work.

I think the impression of the environmental costs is greatly hampered by the shortages on hardware. You can run models on a home GPU or a modern CPU and it does not take long at all for these tasks. So compared to a few minutes of any other application, or streaming a second or two of video, it's really quite minimal.