News for hackers. Stuff that matters.

A comment on Bringing K/V context quantisation to Ollama. Parent comment

Re:Bringing K/V context quantisation to Ollama by satvikpendem on Wednesday December 04, 2024 @10:07PM (#42324419)
I'm running OpenWebUI via Docker via OrbStack, it also automatically provides TLS and works pretty well.
[ Parent | on HN ]

There are no comments on this comment yet.