top | item 47089134

(no title)

fumeux_fume | 9 days ago

Seeing half of an AR LLM's output tokens go to generating a predefined json schema bothers me so much. I would love to have an option to use diffusion for infilling.

discuss

order

jmalicki|9 days ago

One trick I learned for this was to use csv for LLM I/I and translate json <-> csv at the boundary layer

fumeux_fume|9 days ago

Oh neat. So have the llm output csv instead of JSON and then convert it? How would handle nested structures?