top | item 47203057

(no title)

FuckButtons | 1 day ago

A 3 bit quant will run on a 128gb MacBook Pro, it works pretty well.

discuss

nl|1 day ago

A 3 bit quant is quite a lot weaker than the OpenRouter version the OP is using.