[isaacfung]

Maybe it's easier to understand in the format of annotated code

https://nlp.seas.harvard.edu/2018/04/03/attention.html

[ronald_petty]

Updated (in case above link goes away) - https://nlp.seas.harvard.edu/annotated-transformer/

Thanks for original!