I think I need to see some really convincing and detailed examples to understand what's going on here.
Does DSPy have good debugging hooks for things like "print out every prompt that is generated to a log"?
When I'm evaluating a new piece of technology the number one question I want to answer is "what are the projects that adopting this technology enables me to build that I couldn't have built without it?" - either by giving me a new capability or by reducing the amount of work I have to put in to the point that a project now fits in my available time where it didn't before.
simonw|2 years ago
Does DSPy have good debugging hooks for things like "print out every prompt that is generated to a log"?
When I'm evaluating a new piece of technology the number one question I want to answer is "what are the projects that adopting this technology enables me to build that I couldn't have built without it?" - either by giving me a new capability or by reducing the amount of work I have to put in to the point that a project now fits in my available time where it didn't before.
okhat|2 years ago
This Colab is full of prompts and examples of improving the quality of gpt-3.5-turbo: https://t.co/Oa1RDp3XbZ
Paper incoming, but basically we've seen > 50% quality gains by just compiling in various settings.
This Twitter/X thread discusses doing a simple program for Llama2, with massive quality gains too: https://twitter.com/lateinteraction/status/16947484013744909...