top | item 42095768

(no title)

atlex2 | 1 year ago

Seriously nobody thought to use SVD on these weight matrices before?

discuss

order

liuliu|1 year ago

I did try, but in a wrong way (try to SVD quantization error to recover quality (I.e. SVD(W - Q(W)))). The lightbulb moment in this paper is to do SVD on W and then quantize the remaining.