top | item 46126865 (no title) dloss | 2 months ago Yes, the 3B variant, with vLLM 0.11.2. Parameters are given on the HF page. Had to override the temperature to 0.15 though (as suggested on HF) to avoid random looking syllables. discuss order hn newest No comments yet.
No comments yet.