News for hackers. Stuff that matters.
Re:What We Learned from a Year of Building with LLMs by rcarmo on Wednesday May 29, 2024 @03:20AM (#40509366)
Via APIs, yes. But if you have direct access to the model you can use libraries like https://github.com/guidance-ai/guidance to manipulate the output structure directly.
Re:What We Learned from a Year of Building with LLMs by __loam on Wednesday May 29, 2024 @03:49AM (#40509520)
This seems like it could do some cool code completion stuff with local models.