News for hackers. Stuff that matters.

A comment on LLM Chat via SSH.

Re:LLM Chat via SSH by gclawes on Monday June 16, 2025 @09:55AM (#44289520)
Is this doing local inference? If so, what inference engine is it using?
[ Parent | on HN ]
Re:LLM Chat via SSH by demosthanos on Monday June 16, 2025 @10:13AM (#44289692)
No, it's a thin wrapper around an API, probably OpenRouter or similar:

https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...

[ Parent | on HN ]
Re:LLM Chat via SSH by ccbikai on Tuesday June 17, 2025 @09:48PM (#44305927)
Currently using the OpenAI API to access multiple models. You can use ollama to access local inference models
[ Parent | on HN ]