top | item 47127737

(no title)

devnonymous | 7 days ago

Are you sure about that ? Because the very next tweet says:

  > Distillation can be legitimate: AI labs use it to create smaller, cheaper models for their customers.

discuss

order

davidgomes|7 days ago

That's just in reference to the technique itself. They're basically saying it's okay for Google to use distillation to train Gemini N Flash using Gemini N-1 Pro (which they do).