top | item 46964601

(no title)

mmis1000 | 19 days ago

This article always end up relevant once in a while.

Recently, I am trying to make llm to output specific format.

It turns out no matter how you wrote propmt and perform validate. It will never be as effective as just limit the output with proper bnf (via llama cpp grammar file).

discuss

order

No comments yet.