Accelerate CPU Based LLM Inference with a Vector Index on the Output Embeddings

1 points| dithered_djinn | 11 months ago |martinloretz.com