top | item 47204123

(no title)

verma7 | 18 hours ago

I wrote a C++ translation of it: https://github.com/verma7/microgpt/blob/main/microgpt.cc

2x the number of lines of code (~400L), 10x the speed

The hard part was figuring out how to represent the Value class in C++ (ended up using shared_ptrs).

discuss

order

WithinReason|14 hours ago

I made an explicit reverse pass (no autodiff), it was 8x faster in Python