[vitaelabitur]

> Increasing context length by complaining about schema errors is almost always worse from an end quality perspective than just retrying till the schema passes.

Another way to do this is to use a hybrid approach. You perform unconstrained generation first, and then constrained generation on the failures.

[hansvm]

There's no difference in the output distribution between always doing constrained generation and only doing it on the failures though. What's the advantage?

[vitaelabitur]

There's no advantage wrt output quality, but it can be more economical in some high-error regimes, with less LLM calls used in resampling (max 2 for most errors).