top | item 40339862 (no title) Oranguru | 1 year ago You can easily fix this using a grammar constraint with llama.cpp. Add this to the command: --grammar "root ::= [^一-鿿ぁ-ゟァ-ヿ가-힣]*"This will ban Chinese characters from the sampling process. Works for Yi and Qwen models. discuss order hn newest No comments yet.
No comments yet.