top | item 36821358

(no title)

SCHiM | 2 years ago

No, the way it works is that the current output + potential next tokens to be sampled are checked with the grammar. All potential tokens that don't match are removed. Then, with the list of valid tokens left, normal sampling strategies are used.

discuss

order

No comments yet.