top | item 45923474

(no title)

CrackerNews | 3 months ago

I think video and agentic and multimodal models have led to this point, but actually making a world model may provide to be long and difficult.

I feel LeCun is correct that LLMs as of now have limitations where it needs an architectural overhaul. LLMs now have a problem with context rot, and this would hamper with an effective world model if the world disintegrates and becomes incoherent and hallucinated over time.

It'd doubtful whether investors would be in for the long haul, which may explain the behavior of Sam Altman in seeking government support. The other approaches described in this article may be more investor friendly as there is a more immediate return with creating a 3D asset or a virtual simulation.

discuss

order

No comments yet.