top | item 41792297

Directly run and investigate Llama models locally with only PyTorch

3 points| anordin95 | 1 year ago |github.com

1 comment

order

anordin95|1 year ago

There are other popular ways to invoke these models, such as Ollama and Hugging-Face's general API package: transformers, but those hide the interesting details behind an API. Peel back the layers to poke, prod and understand!