This is mostly because how current LLMs are learning stuff my memorizing stuff.
Worst thing of AI through LLM is rote learning where same model is used for reasoning and memorizing.
Hopefully in future it will be like small core of language understanding and reasoning which ideally can look up a reference ( through search ) and use RL to get better at the topic through trial and error
No comments yet.