[cataPhil]

I recently decided to turbo-teach myself basic cuda with a proper project. I really enjoyed Karpathy’s micrograd (https://github.com/karpathy/micrograd), so I extended it with cuda kernels and 2D tensor logic. It’s a bit longer than the original project, but it’s still very readable for anyone wanting to quickly learn about gpu acceleration in practice.

[lairv]

If you ever feel like improving your matmul kernel you can check this blog https://siboehm.com/articles/22/CUDA-MMM

[cataPhil]

Thanks! I will probably do that this weekend

[coolThingsFirst]

Lovely project, what did you find as the beat place to learn about cuda?

[cataPhil]

Thanks! I highly recommend the book Programming Massively Parallel Processors

[lagrange77]

Awesome, thank you for publishing it. I was planning the same, but didn't find the time yet.

[quibono]

Is your work publicly available anywhere? I'd love to have a look if possible.

[cataPhil]

Hi :) Yes it's in the post url or here: https://github.com/mlecauchois/micrograd-cuda