top | item 45346960 (no title) FlyingLawnmower | 5 months ago If your masking is fast enough, you can make it easily work with spec dec too :). We manage to keep this on CPU. Some details here: https://github.com/guidance-ai/llguidance/blob/main/docs/opt... discuss order hn newest No comments yet.
No comments yet.