top | item 34897939

(no title)

scottward | 3 years ago

Cool! It would be nice to use this to quickly iterate on the prompts I plan to use within https://app.habitstack.com. Basically, supply the user input in the query string and get back the result. Then in Pancaik see the log of combined prompts, the results, and be able to fine tune the prompts over time. Any plans to go that direction?

discuss

order

thesunny|3 years ago

Yes, I have plans to log user provided inputs and the responses from GPT. You can monitor these inputs/responses to see if the responses that are coming back are of high quality. If it feels like you can improve the prompt, you will be able to use a prompt engineering tool which will let you experiment with different prompts and run them against a bunch of user inputs. You can then compare the new responses to the old ones and see if it's an improvement.

If you're thinking of integrating into another app, one of the next steps is to be able to take the AI web app you built and turn it into a component that you can put into your own websites/web apps. Also, at this point, you will be able to have inputs that are not just user provided, but can also come from your website/web app (e.g. data from your database).

scottward|3 years ago

Yeah, that all seems very useful.