[abhinavkulkarni]

There already are techniques to guade LLMs into producing output that adhere to a schema. For e.g. forcing LLMs to stick to a Context-Free Grammar: https://matt-rickard.com/context-free-grammar-parsing-with-l...

Just like many similar methods, this is based on logit biasing, so it may have an impact on quality.