[sir_eliah]

Thanks for the input! I asked about the scale of items and traffic, because my use case actually requires separate piece of infrastructure. It's around 100 millions of items and live production traffic from millions of users with high latency demand. So it's not a batch job that can be performed in memory, as I understand your case.

Currently I use Elasticsearch with the Open Distro approximate kNN plugin by the way.

[gk1]

We at Pinecone have lots of customers at those operating levels (and many that are even higher)... If a managed option is viable for you.

[jamesblonde]

Why are you not using the latest OpenSearch instead of Elastic with the older Open Distro kNN plugin?

[sir_eliah]

Maybe I was not precise, I in fact use OpenSearch, but since it's a fork to ES, I consider this to be the same DB, architecture-wise.