[mehulashah]

I do believe it’s time for systems folks to take a hard look at building systems abstractions on top of LLMs as they did 50 years ago on top of CPUs. LLMs are the new universal computing machines, but we build with them like we built computers in the 1950s - one computer at a time.

[csmpltn]

This is the wrong take.

There's a point beyond which LLMs are an overkill, where a simple script or a "classic" program can outdo the LLM across speed, accuracy, scalability, price and more. LLMs aren't supposed to solve "universal computing". They are another tool in the toolbox, and it's all about using the right tool for the problem.

[mehulashah]

I shared your opinion for a while. But, that’s not what’s happening. People are using them for everything. When they do, expectations are set. Vendors will adjust and so will the rest of the industry. It’s happening.

[moduspol]

CPUs are deterministic! I think it’s going to be inherently limiting how far you can abstract above something non-deterministic.

[mehulashah]

Agree. The non-determinism is a problem. Perhaps systems thinking can help here. After all, traditional computer systems often behave non-deterministically and we’ve learned to make them more reliable.

[vjvjvjvjghv]

Using LLMs for universal computing would be crazy inefficient. On top of that they aren't deterministic (at the moment) so building systems on top of that would be shaky

[narrator]

LLMs are already hard to interpret as it is. Why not just have some minimal linux so at least someone with a linux background can observe and easily make sense of its actions? If we make an unfamiliar opaque virtual machine, it's likely to be even less user friendly.

[eldenring]

Hmmmm I don't think that would make sense. Closest analogy is working with humans. The easiest way to work with a human isn't a thin, limited api, but rather to give them context and work together (employment). I think the future of software will look more like Claude Code. Lets the model work in a similar space as us, where it can intelligently seek out information and use tools as a human would.

[lloydatkinson]

I can’t believe such hyperbolic fantasies are on HN now too.