News for hackers. Stuff that matters.
Re:LLM Chat via SSH by kimjune01 on Saturday June 14, 2025 @01:43AM (#44274457)
hey i just tried it. it's cool! i wish it was more self aware
Re:LLM Chat via SSH by ccbikai on Saturday June 14, 2025 @06:08AM (#44275412)
Thank you for your feedback; I will optimize the prompt
Re:LLM Chat via SSH by ccbikai on Saturday June 14, 2025 @06:08AM (#44275409)
I am the author, thank you for your support.

Welcome to help maintain it with me

Re:LLM Chat via SSH by amelius on Monday June 16, 2025 @08:50AM (#44289050)
I'd rather apt-get install something.

But that seems not a possibility in the modern days of software distribution, especially with GPU-dependent stuff like LLMs.

So yeah, I get why this exists.

Re:LLM Chat via SSH by halJordan on Monday June 16, 2025 @10:53PM (#44295331)
What is the complaint here? There are plenty of binaries you can invoke through your cli that will query a remote llm api
Re:LLM Chat via SSH by dncornholio on Monday June 16, 2025 @09:10AM (#44289178)
Using React to render a CLI tool is something. I'm not sure how I feel about that. It feels like like 90% of the code is handling issues with rendering.
Re:LLM Chat via SSH by demosthanos on Monday June 16, 2025 @10:12AM (#44289687)
I mean, it's a thin wrapper around LLM APIs, so it's not surprising that most of the code is rendering. I'm not sure what you're referring to by "handling issues with rendering", though—it looks like a pretty bog standard React app. Am I missing something?
Re:LLM Chat via SSH by eisbaw on Monday June 16, 2025 @09:20AM (#44289258)
Why not telnet?
Re:LLM Chat via SSH by accrual on Monday June 16, 2025 @09:57AM (#44289542)
I'd love to see an LLM outputting over a Teletype. Just tschtschtschtsch as it hammers away the paper feed.
Re:LLM Chat via SSH by cap11235 on Monday June 16, 2025 @10:43AM (#44290050)
Last week or so, there was the LLM finetune posted that speaks like a 19th century Irish author. I look forward a bit to having an LLModem model.
Re:LLM Chat via SSH by RALaBarge on Monday June 16, 2025 @09:23AM (#44289279)
No HTTPS support
Re:LLM Chat via SSH by benterix on Monday June 16, 2025 @09:40AM (#44289421)
I bet someone can write an API Gateway for this...
Re:LLM Chat via SSH by gsibble on Monday June 16, 2025 @09:23AM (#44289275)
We made this a while ago on the web:

https://terminal.odai.chat

Re:LLM Chat via SSH by t0ny1 on Monday June 16, 2025 @09:38AM (#44289410)
does this project request to llm providers?
Re:LLM Chat via SSH by cap11235 on Monday June 16, 2025 @10:38AM (#44289994)
Are you serious? Yeah, its using gemini 2.5 pro without a server, sure yeah.
Re:LLM Chat via SSH by gclawes on Monday June 16, 2025 @09:55AM (#44289520)
Is this doing local inference? If so, what inference engine is it using?
Re:LLM Chat via SSH by demosthanos on Monday June 16, 2025 @10:13AM (#44289692)
No, it's a thin wrapper around an API, probably OpenRouter or similar:

https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...

Re:LLM Chat via SSH by ccbikai on Tuesday June 17, 2025 @09:48PM (#44305927)
Currently using the OpenAI API to access multiple models. You can use ollama to access local inference models
Re:LLM Chat via SSH by demosthanos on Monday June 16, 2025 @10:08AM (#44289641)
Skimming the source code I got really confused to see TSX files. I'd never seen Ink (React for CLIs) before, and I like it!

Previously discussions of Ink:

July 2017 (129 points, 42 comments): https://news.ycombinator.com/item?id=14831961

May 2023 (588 points, 178 comments): https://news.ycombinator.com/item?id=35863837

Nov 2024 (164 points, 106 comments): https://news.ycombinator.com/item?id=42016639

Re:LLM Chat via SSH by ccbikai on Tuesday June 17, 2025 @09:47PM (#44305920)
Many CLI applications are now using Ink to write their UIs.

I suspect React will eventually standardize all UI writing approaches.

Re:LLM Chat via SSH by ryancnelson on Monday June 16, 2025 @12:19PM (#44290982)
this is neat.... whose anthropic credits am i using, though? sonnet-4 isn't cheap! would i hit a rate-limit if i used this for daily work?
Re:LLM Chat via SSH by gbacon on Monday June 16, 2025 @12:27PM (#44291047)
Wow, that produced a flashback to using TinyFugue in the 90s.

https://tinyfugue.sourceforge.net/

https://en.wikipedia.org/wiki/List_of_MUD_clients

Re:LLM Chat via SSH by xigoi on Monday June 16, 2025 @05:31PM (#44293582)
It’s not clear from the README what providers it uses and why it needs your GitHub username.
Re:LLM Chat via SSH by ccbikai on Tuesday June 17, 2025 @09:45PM (#44305906)
Connects to any OpenAI-compatible API.

Using a GitHub username prevents abuse.