top | item 46351436

(no title)

am17an | 2 months ago

Use llama.cpp? I get 250 toks/sec on gpt-oss using a 4090, not sure about the mac speeds

discuss

order

No comments yet.