Re:Building Boba AI: Lessons learnt in building an LLM-power...
by icyfox on Thursday June 29, 2023 @09:20PM
(#36529346)
Sure - I'm using it in a few different internal tools and know others are using it in production. The API should be relatively stable at this point since I intentionally kept the scope pretty limited. The main changes over time will be improved robustness and error correction as issues report different JSON schema breaks that we can fix automatically. Let me know if you see more cases that can be addressed here, would love to collaborate on it.
Re:Building Boba AI: Lessons learnt in building an LLM-power...
by darkteflon on Thursday June 29, 2023 @10:29PM
(#36529820)
Thanks! Absolutely, will do. I’ll have a play with it today and reach out with a PR any time it makes sense to do so.
I noticed some occasional funkiness from GPT-4 around sending back properly formatted dates yesterday but haven’t yet dug into it properly. Might be a good candidate for a transformation.
I’d like to incorporate this in a production workflow for generating schema-compliant test data for use in few-shot promoting - would you mind saying a few words about your medium term plans for the library? The LangChain API is changing all the time at the moment so we’re trying to figure out where it’s safe to stand. No expectations, of course, just curious.