top | item 42226592

Structured generation for LLMs performs better - a detailed rebuttal

2 points| bfelbo | 1 year ago |blog.dottxt.co

1 comment

order

234120987654|1 year ago

Great write up and clarification of some of the errors the authors made. The only thing I'm missing is the evaluation of structured generation on longer, complex JSON. In my experience this does tend to fall off depending on the model and the strictness of the imposed JSON structure.