Comment Re:Directionally Right, Specifically Wrong. (Score 1) 101
Understanding cost in the external world requires having a good model of the external world. The current LLMs, IIUC, don't have such a model. They have models of interacting words. It's truly amazing that they can do as much with that as they can, but don't over-read it.
OTOH, other AIs *do* have a world model. Most of those aren't full LLMs though. But even those don't really have a good model of other non-electronic entities. Think of self-driving cars, or robots practicing dance routines. These have a world model, but don't really have lots of other info that LLMs typically have. And even those don't have good models of people or dogs, and how they feel when something happens to them. But for LLMs, the real world *is* their electronic sensations. Words are patterns associated with those sensations. But no "body in the world" is involved in the model.