[rs186]

We talk about "probability" here because the topic is hallucination, not getting different answers each time you ask the same question. Maybe you could make the output deterministic but does not help with the hallucination problem at all.

[sweezyjeezy]

Exactly - 'non-deterministic' is not an accurate diagnosis of the issue.