top | item 42095768 (no title) atlex2 | 1 year ago Seriously nobody thought to use SVD on these weight matrices before? discuss order hn newest liuliu|1 year ago I did try, but in a wrong way (try to SVD quantization error to recover quality (I.e. SVD(W - Q(W)))). The lightbulb moment in this paper is to do SVD on W and then quantize the remaining.
liuliu|1 year ago I did try, but in a wrong way (try to SVD quantization error to recover quality (I.e. SVD(W - Q(W)))). The lightbulb moment in this paper is to do SVD on W and then quantize the remaining.
liuliu|1 year ago