This is what I assumed considering it had the right answer but the explanations were garbled. Presumably it reproduced the answer, and then some weird patchwork of the various explanations in its training set.
Reminds me of the experiment where split brain patients (those with their corpus callosum cut which connects the hemispheres of the brain together) had their eyes projected with different images. They could perform tasks but not be able to explain why they did it or make up nonsensical explanations which they believed to be completely correct.
satvikpendem|3 years ago