top | item 40619918

Show HN: A Small BitNet GPT in MLX

4 points| cafed00d | 1 year ago |github.com

For those of us nerds who like to tinker with language models, I thought of sharing an example ipynb that shows how to build a small gpt (kudos to @karpathy for teaching us minGPT) where you replace the nn.Linear layer with a BitLinear layers as introduced in the paper on 1.58 bit LLMs https://arxiv.org/abs/2402.17764

discuss

order

No comments yet.