hhdhdbdb's comments

hhdhdbdb | 1 year ago | on: GitHub cuts AI deals with Google, Anthropic

LLMs make my job as a software engineer even more secure. Most of what I do is social and/or understand what is going on. LLMs are a tool to reduce mental load when in VSCode on some tasks. They are like the pilot's autopilot.

LLM takes my job then we have reached the singularity. Jobs wont matter anymore at that point.

hhdhdbdb | 1 year ago | on: Vector databases are the wrong abstraction

That is arguable because while it is a calculated field, it is not a pure one (IO is required), and not necessarily idempotent, not atomic and not guaranteed to succeed.

It is certainly convenient for the end user, but it hides things. What if the API calls to open AI fail or get rate limited. How is that surfaced. Will I see that in my observability. Will queries just silently miss results.

If the DB does the embedding itself synchronously within the write it would make sense. That would be more like elastic search or a typical full text index.

hhdhdbdb | 1 year ago | on: Vector databases are the wrong abstraction

Pretty smart. Why is the DB api the abstraction layer though? Why not two columns and a microservice. I assume you are making async calls to get the embeddings?

I say that because it seems n unsual. Index would suit sync better. But async things like embeddings, geo for an address, is this email considered a spammer etc. feel like app level stuff.

page 2