[mvuksano]

I don't even care if it's reproducible or not. I care it gives me correct responses to my questions and that's all.

[ehnto]

Isn't part of making it reproducible also part of ensuring correct results? Especially if we start putting these models into important systems. And if these models begin to update in an evergreen fashion, or utilize realtime data, getting verifiable or repeatable outputs will be a nightmare if we have no idea how to make these models repeatably.

[visarga]

> if we have no idea how to make these models repeatably

We have idea about how to reproduce but using deterministic training mode is very slow as it loses some optimisations.

[diputsmonro]

There's really no way to be sure that it will.