top | item 40811566

(no title)

XzAeRosho | 1 year ago

It's on HuggingFace already: https://huggingface.co/google/gemma-2-9b

discuss

order

luke-stanley|1 year ago

I know the safe tensors are there, but I said GGUF 4-bit quantised, which is kinda the standard for useful local applications, a typical balanced sweet spot of performance and quality. It's makes it much easier to use, works in more places, be it personal devices or a server etc.