top | item 41917645 (no title) schmeichel | 1 year ago This seems promising! Great work! Any chance there will be a Ollama Modelfile for the masses? discuss order hn newest peakji|1 year ago GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-ggufI haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF? ca_tech|1 year ago You can now run any huggingface model using the following commandollama run hf.co/{username}/{repository}Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_MSource: https://huggingface.co/docs/hub/en/ollama
peakji|1 year ago GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-ggufI haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF? ca_tech|1 year ago You can now run any huggingface model using the following commandollama run hf.co/{username}/{repository}Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_MSource: https://huggingface.co/docs/hub/en/ollama
ca_tech|1 year ago You can now run any huggingface model using the following commandollama run hf.co/{username}/{repository}Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_MSource: https://huggingface.co/docs/hub/en/ollama
peakji|1 year ago
I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?
ca_tech|1 year ago
ollama run hf.co/{username}/{repository}
Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M
Source: https://huggingface.co/docs/hub/en/ollama