[iraldir]

- Did not work on firefox for me (start conversation and nothing would happen, I would not hear the voice) - on chrome it would not allow to change my microphone so had to open my macbook. - Also on firefox, when I first logged in, clicking on he "try now" button would send me back to the landing page, I had to go and click on the playground

With that out of the way, it's really interesting. The challenge I suppose is how narrow / wide the API made by the developer is. A narrow case, like "booking a dentist appointment", might feel like a step down compared to an online form, and most likely would fail short of satisfying someone calling, because if they're calling they had some deeper needs.

On the other hand, a wide API, like if you gave access to pricing information of the dental practice, info about the doctors, a way to reach an actual human being, health advice and post op advice, generate documents from past appointments etc, and you have a higher chance of hallucination, misclassification of what the user wants etc.

I'm still not sure if the best approach is just to leave the AI to deal with that, or to represent the user intent etc. with some sort of State Machine. Maybe a case by case etc. But the more you add in that logic, the slower the machine is.