top | item 46879418

(no title)

verytrivial | 27 days ago

Tldr: 5% - 17% speedup due to removing a bottleneck by juggling where on a GPU/compute core a computation is done during Flash attention.

discuss

order

No comments yet.