top | item 46874376

(no title)

disiplus | 26 days ago

im downloading it as we speek to try to run it on a 32gb 5090 + 128gb ddr5 i will compare it to glm 4.7-flash that was my local model of choice

discuss

order

gitpusher|26 days ago

Likewise curious to hear how it goes! 80B seems too big for a 5090, I'd be surprised if it runs well un-quantized.

wilkystyle|26 days ago

Interested to hear how this goes!