Ask HN: What's a standard way for apps to request text completion as a service?

Re:Ask HN: What's a standard way for apps to request text co... by kristopolous on Saturday January 10, 2026 @09:55AM (#46566203)

I've been working on a more unixy version of his tool I call llcat. Composable, stateless, agnostic, and generic:

It might help things get closer..

It's under 2 days old and it's already really fundamentally changing how I do things.

Also for edge running look into the LFM 2.5 class of models: https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct

[ Parent | on HN ]

Re:Ask HN: What's a standard way for apps to request text co... by mirror_neuron on Saturday January 10, 2026 @10:43AM (#46566637)

I love this concept. Looks great, I will definitely check it out.

[ Parent | on HN ]

Re:Ask HN: What's a standard way for apps to request text co... by kristopolous on Saturday January 10, 2026 @07:29PM (#46571470)

Please use it and give me feedback. I'm going to give a lightning talk on it tonight at sfvlug

[ Parent | on HN ]