top | item 46847787

(no title)

bendangelo | 29 days ago

I didn't know sqlite had a vector extension. I'm also using nomic 1.5 with 256 size vectors. After about 44k entries searching is way too slow. I'm thinking about reducing the size to half. What size are you using?

For text search, I'm using lnx which is based off of Tantivy.

I disabled the vector search feature for now but I will re-enable it after some optimization. The site is at https://stray.video

discuss

order

cckolon|29 days ago

I use full length vectors (512 dimensions) and have seen very fast lookups with pgvector (HNSW index) and sqlite-vec on 20k vectors. I think any decent vector database should be able to handle 44k entries… which one are you using now?