top | item 47087310

(no title)

cma | 9 days ago

When you predict with the small model, the big model can verify as more of a batch and be more similar in speed to processing input tokens, if the predictions are good and it doesn't have to be redone.

discuss

order

No comments yet.