[jhancock]

sure. It may be more than that...possibly due to variable operating params on the servers and current load.

On whole, if I compare my AI assistant to a human worker, I get more variance than I would from a human office worker.

[pixl97]

Thats because you don't 'own' the LLM compute. If you instead bought your office workers by the question I'm sure the variability would increase.

[astrange]

They're not really capable of producing varying answers based on load.

But they are capable of producing different answers because they feel like behaving differently if the current date is a holiday, and things like that. They're basically just little guys.