Guidance: A guidance language for controlling large language models

Re:Guidance: A guidance language for controlling large langu... by Forgotthepass8 on Saturday September 16, 2023 @08:16PM (#37540199)

LMQL seems to be alive and takes some of these concepts even further. It's the project of 1 or 2 PhD students at ETH Zürich so I'm hopeful they'll see it through.

I thought guidance was smart, but LMQL seems brilliant as it merges pythonic constructions with LLMs (I think it may be an outright superset of python with LLM functionalities?)

It's predicated off a paper as well : https://arxiv.org/pdf/2212.06094

[ Parent | on HN ]

Re:Guidance: A guidance language for controlling large langu... by verdverm on Saturday September 16, 2023 @08:45PM (#37540371)

LMQL requires a user to learn a bespoke programming language. Not a good idea, no one really wants to have to learn a new programming language to work with one library or framework. You have to have a really compelling offering. With LLMs, the libraries and frameworks are a dime-a-dozen, so it's going to be a much bigger ask of your users

[ Parent | on HN ]

Re:Guidance: A guidance language for controlling large langu... by Forgotthepass8 on Monday September 18, 2023 @12:04PM (#37558069)

I see your point but at the same time I'm looking for alternatives and guidance isn't really alive and langchain is just... a lot of stuff(arguably bloat..) and I don't see any obvious easy value from it like I see in lmql/guidance.

[ Parent | on HN ]