minwidth0px
Re:Bringing K/V context quantisation to Ollama
on Thursday December 05, 2024 @11:12AM (#42329488)
I wrote my own UI[0] that connects over WebRTC using Smoke.[1]
[0] https://github.com/minwidth0px/gpt-playground and https://github.com/minwidth0px/Webrtc-NAT-Traversal-Proxy-Se...