Re:Stanford DSPy: The framework for programming with foundat...
by okhat on Thursday September 07, 2023 @09:58AM
(#37419003)
"print out every prompt that is generated to a log" --- yes of course
This Colab is full of prompts and examples of improving the quality of gpt-3.5-turbo: https://t.co/Oa1RDp3XbZ
Paper incoming, but basically we've seen > 50% quality gains by just compiling in various settings.
This Twitter/X thread discusses doing a simple program for Llama2, with massive quality gains too: https://twitter.com/lateinteraction/status/16947484013744909...
Does DSPy have good debugging hooks for things like "print out every prompt that is generated to a log"?
When I'm evaluating a new piece of technology the number one question I want to answer is "what are the projects that adopting this technology enables me to build that I couldn't have built without it?" - either by giving me a new capability or by reducing the amount of work I have to put in to the point that a project now fits in my available time where it didn't before.