Either this is a missing layer, and we’ll get there soon, or one could say verification is happening through the statistical model. We need to see if we can train hallucinations out by having it rely on a stable data store to retrieve facts rather than trying to pull facts from the model itself. This is still similar to how the brain has discrete components for memory storage and retrieval.
webmaven|3 years ago
The brain has discrete components for coordinating storage and retrieval (essentially, the "on demand" aspect needs specialization), but the actual memories are rather thoroughly distributed throughout (though not evenly so to the extent that the "holographic" models of yesteryear would have had it).
mdp2021|3 years ago
Hopefully - but that would be the absolutely critical part.
> stable data store to retrieve facts rather than trying to pull facts from the model itself
This is not clear: intelligence is a process of refinement of a world model.