News for hackers. Stuff that matters.
Re:Taming LLMs – A Practical Guide to LLM Pitfalls with Open... by jackmpcollins on Friday December 13, 2024 @02:34AM (#42406643)
If you are using Python, check out the package I've been building, magentic https://github.com/jackmpcollins/magentic It supports structured outputs and streaming, and aims to avoid making unnecessary abstractions (but might require some more understanding of LLM patterns as a result).

Also recently released is pydantic-ai, which is also based around pydantic / structured outputs, though works at level of "agents". https://github.com/pydantic/pydantic-ai

There are no comments on this comment yet.