top | item 47089134 (no title) fumeux_fume | 9 days ago Seeing half of an AR LLM's output tokens go to generating a predefined json schema bothers me so much. I would love to have an option to use diffusion for infilling. discuss order hn newest jmalicki|9 days ago One trick I learned for this was to use csv for LLM I/I and translate json <-> csv at the boundary layer fumeux_fume|9 days ago Oh neat. So have the llm output csv instead of JSON and then convert it? How would handle nested structures? load replies (1)
jmalicki|9 days ago One trick I learned for this was to use csv for LLM I/I and translate json <-> csv at the boundary layer fumeux_fume|9 days ago Oh neat. So have the llm output csv instead of JSON and then convert it? How would handle nested structures? load replies (1)
fumeux_fume|9 days ago Oh neat. So have the llm output csv instead of JSON and then convert it? How would handle nested structures? load replies (1)
jmalicki|9 days ago
fumeux_fume|9 days ago