Micrograd-CUDA: adapting Karpathy's tiny autodiff engine for GPU acceleration

[cataPhil]

I recently decided to turbo-teach myself basic cuda with a proper project. I really enjoyed Karpathy’s micrograd (https://github.com/karpathy/micrograd), so I extended it with cuda kernels and 2D tensor logic. It’s a bit longer than the original project, but it’s still very readable for anyone wanting to quickly learn about gpu acceleration in practice.

[lairv]

If you ever feel like improving your matmul kernel you can check this blog https://siboehm.com/articles/22/CUDA-MMM

[coolThingsFirst]

Lovely project, what did you find as the beat place to learn about cuda?

[lagrange77]

Awesome, thank you for publishing it. I was planning the same, but didn't find the time yet.

[quibono]

Is your work publicly available anywhere? I'd love to have a look if possible.

[kosolam]

Awesome. Thanks

[suhacker256]

Very cool!!

[zer0zzz]

Cool