News for hackers. Stuff that matters.

A comment on Bringing K/V context quantisation to Ollama. Parent comment

Re:Bringing K/V context quantisation to Ollama by minwidth0px on Thursday December 05, 2024 @11:12AM (#42329488)
I wrote my own UI[0] that connects over WebRTC using Smoke.[1]

[0] https://github.com/minwidth0px/gpt-playground and https://github.com/minwidth0px/Webrtc-NAT-Traversal-Proxy-Se...

[1] https://github.com/sinclairzx81/smoke

[ Parent | on HN ]

There are no comments on this comment yet.