Speculative sampling: LLMs writing a lot faster using smaller LLMs

4 points| spolu | 2 years ago |blog.dust.tt