top | item 45540954 Galton Board Softmax O(N2) Replacement 1 points| quatonion | 4 months ago |github.com 1 comment order hn newest quatonion|4 months ago For some time I have been trying to replace the very costly attention pass in LLMs.Here is my current attempt at fixing things.This is applicable beyond LLMs, but that is certainly an important use case.Description, Ready to use Code and Interactive Educational materials inside.
quatonion|4 months ago For some time I have been trying to replace the very costly attention pass in LLMs.Here is my current attempt at fixing things.This is applicable beyond LLMs, but that is certainly an important use case.Description, Ready to use Code and Interactive Educational materials inside.
quatonion|4 months ago
Here is my current attempt at fixing things.
This is applicable beyond LLMs, but that is certainly an important use case.
Description, Ready to use Code and Interactive Educational materials inside.