[kkzz99]

Afaik they have a test bench that they use and take the activation data from that.

[danielhanchen]

Yes we have around 1 to 3 million tokens of high quality self verified data that we use to calibrate models!