Training a 67M-parameter transformer on an M4 Mac Mini

[recrush]

Cool post. And you might find it interesting. https://github.com/KellerJordan/modded-nanogpt

[Geddydukes]

Thanks, I hadn't seen this repo before I'll check it out!

[throwfaraway4]

Cool post but the cursor shadow is a huge distraction

[Geddydukes]

Just went ahead and removed that, thanks for the comment and hopefully this will make it less distracting.