top | item 38486109 (no title) thecal | 2 years ago I really like Inkbot! Are you working on a new version? How about one from Yi 34B? discuss order hn newest Tostino|2 years ago Yeah, I will be soon.I was busy adding `chat template` support to vLLM recently, so the model (and any others that implement it properly) will work seamlessly with a clone of the OpenAI chat/completions endpoint.https://github.com/vllm-project/vllm/pull/1756Now that I have that out of the way, back to model training ;). thecal|2 years ago Very cool, looking forward to it!
Tostino|2 years ago Yeah, I will be soon.I was busy adding `chat template` support to vLLM recently, so the model (and any others that implement it properly) will work seamlessly with a clone of the OpenAI chat/completions endpoint.https://github.com/vllm-project/vllm/pull/1756Now that I have that out of the way, back to model training ;). thecal|2 years ago Very cool, looking forward to it!
Tostino|2 years ago
I was busy adding `chat template` support to vLLM recently, so the model (and any others that implement it properly) will work seamlessly with a clone of the OpenAI chat/completions endpoint.
https://github.com/vllm-project/vllm/pull/1756
Now that I have that out of the way, back to model training ;).
thecal|2 years ago