News for hackers. Stuff that matters.

A comment on Jev in 25 Lines of Python. Parent comment

Re:Jev in 25 Lines of Python by nautilus50 on Wednesday September 23, 2026 @04:28AM (#49813156)
+1, llama.cpp has a --grammar parameter which you can pass a BNF style grammar file to constrain generation. It can be used in Python llama.cpp wrapper

https://til.simonwillison.net/llms/llama-cpp-python-grammars

[ Parent | on HN ]
Re:Jev in 25 Lines of Python by porridgeraisin on Wednesday September 23, 2026 @05:00AM (#49813375)
Yes. But even then, the probabilities are not calibrated. In jev/laya, they are (well, relatively anyways).
[ Parent | on HN ]