[dmayle]

Did you finetune it before trying? Docs here:

https://ai.google.dev/gemma/docs/core/huggingface_text_full_...

[Workaccount2]

How well does using a SOTA model for fine-tuning work? I'm sure people have tried

[perching_aix]

Thanks, will check that out as well tomorrow or during the weekend!

[canyon289]

If you know you want JSON for sure constrained decoding in an inference framework will help. The model is just one part of an overall inference system. I hope this model paired with other tools help you get done whatever it is you're looking to get done