user: chaoyu

32 karma | created 11 years ago

Twitter @chaoyu_

recent submissions

Benchmarking LLM Inference Back Ends: VLLM, LMDeploy, MLC-LLM, TensorRT-LLM, TGI (bentoml.com)

15 pts|1 year ago|1 comment

(no title)

1 year ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

(no title)

2 years ago|discuss

Show HN: ML Serving orchestration framework on Kubernetes (github.com)

2 pts|3 years ago|discuss

(no title)

4 years ago|discuss

(no title)

5 years ago|discuss

BentoML: The easiest way to build Machine Learning APIs (github.com)

4 pts|5 years ago|1 comment

(no title)

5 years ago|discuss

(no title)

5 years ago|discuss

(no title)

6 years ago|discuss

(no title)

6 years ago|discuss

(no title)

6 years ago|discuss