News for hackers. Stuff that matters.

A comment on Localllm lets you develop gen AI apps on local CPUs. Parent comment

Re:Localllm lets you develop gen AI apps on local CPUs by behnamoh on Wednesday February 07, 2024 @11:28PM (#39298143)
It supports grammar and that's more than enough in practice.
[ Parent | on HN ]
Re:Localllm lets you develop gen AI apps on local CPUs by brucethemoose2 on Thursday February 08, 2024 @07:06AM (#39300989)
Grammar has nothing to do with gguf, as it's logit processing (and that is being integrated into other backends as well).
[ Parent | on HN ]