top | item 40513004

(no title)

sharbloop | 1 year ago

Which GPU card can I buy to run this model? Can it run on commercial RTX3090 or does it need a custom GPU?

discuss

order

Havoc|1 year ago

3090 or 4090 will be able to run quantized 22B models.

Though realistically for code completion smaller models will be better due to speed