[sorokinvj]

Great questions!

Let me try to answer them:

1. Intuitively, the use case "I don't have time to type in prompt, but I want to query AI real-time" does make sense, but is there a real use case where people actually would find it useful and beneficial so that they would pay for this ability - is unknown. We decided to test it in this specific niche and very narrowed down usecase.

2. Currently we use groq-sdk with Mixtral-8x7b. We tried gpt-3.5, gpt-4turbo, claude 3, but for our specific use case speed and the ease of predictable output made groq-sdk our choice for now.

3. RAG is coming, but first we would try something much simpler and launch a feature where you could upload a CV. We would parse it and add to system prompt.

4. Open source is a great idea, but I personally believe that this whole family of voice-driven, real-time ai assistants (that are definitely coming, no questions about it) need a lot of product refinement. Just to share our code now would give immediate value for developers who wants to do the same, but not for the end users. And to be honest, even our code, although being thoughtful and efficient in solving specific challenges (like async orchestration of many bg processes), I don't think it would bring a lot of value now. So yes, once the product side will have more data from users and the product itself would be bit more shaped - sure