News for hackers. Stuff that matters.

A comment on Show HN: Llm2sh – Translate plain-language requests into shell commands.

Re:Show HN: Llm2sh – Translate plain-language requests into ... by conkeisterdoor on Wednesday July 17, 2024 @11:49PM (#40992330)
This looks great! I would use this if you had a dispatcher for using a custom/local OpenAI-compatible API like eg llama.cpp server. If I can make some time I'll take a stab at writing one and submit a PR :)
[ Parent | on HN ]
Re:Show HN: Llm2sh – Translate plain-language requests into ... by RandomBK on Wednesday July 17, 2024 @11:52PM (#40992345)
Already exists :)

Set the `local_uri` setting in the configuration (`llm2sh --setup`), and either pass `-m local` on the CLI or set `"default_model": "local"` in the config.

PRs are always welcome.

[ Parent | on HN ]
Re:Show HN: Llm2sh – Translate plain-language requests into ... by conkeisterdoor on Thursday July 18, 2024 @12:21AM (#40992495)
Thanks so much!
[ Parent | on HN ]