News for hackers. Stuff that matters.

A comment on Bringing K/V context quantisation to Ollama. Parent comment

Re:Bringing K/V context quantisation to Ollama by qudat on Wednesday December 04, 2024 @10:02PM (#42324391)
For hosting a web gui for ollama I use https://tuns.sh

It really convenient because it's just an SSH tunnel and then you get automatic TLS and it protects your home IP.

With that you can access it from your mobile phone, just gotta require a password to access it.

[ Parent | on HN ]
Re:Bringing K/V context quantisation to Ollama by satvikpendem on Wednesday December 04, 2024 @10:07PM (#42324419)
I'm running OpenWebUI via Docker via OrbStack, it also automatically provides TLS and works pretty well.
[ Parent | on HN ]
Re:Bringing K/V context quantisation to Ollama by minwidth0px on Thursday December 05, 2024 @11:12AM (#42329488)
I wrote my own UI[0] that connects over WebRTC using Smoke.[1]

[0] https://github.com/minwidth0px/gpt-playground and https://github.com/minwidth0px/Webrtc-NAT-Traversal-Proxy-Se...

[1] https://github.com/sinclairzx81/smoke

[ Parent | on HN ]