top | item 46126865

(no title)

dloss | 2 months ago

Yes, the 3B variant, with vLLM 0.11.2. Parameters are given on the HF page. Had to override the temperature to 0.15 though (as suggested on HF) to avoid random looking syllables.

discuss

order

No comments yet.