News for hackers. Stuff that matters.

Show HN: A shell CLI tool powered by LLM and RAG (include data security tips)

https://github.com/huangyz0918/termax

Termax leverages the power of LLMs and RAG to dynamically generate shell commands, simplifying complex tasks and enhancing productivity. 1. converts your natural language to commands 2. guess next command 3. ease of use plugin (Ctrl-K)

Thanks for the feedback from the Hacker News Community. We are aware of developers' concerns regarding data safety in the application of LLM and RAG during development. We have enhanced data safety in our project and will keep doing so in the future. Please read the tip and note written in the repo readme before using any of our features to protect your data.

( 4 comments | 4 points | on HN )
Re:Show HN: A shell CLI tool powered by LLM and RAG (include... by huangyz0918 on Tuesday April 16, 2024 @06:57PM (#40058337)
Thank you for sharing this!

Information security is an important issue for applying RAG! No one wants their personal information to go to OpenAI's server, but all users want to have a personalized assistant. -- That's the reason we need guardrails. A good framework you can take a look at: https://github.com/guardrails-ai/guardrails

But, it may not be able to integrate with small LLM agents easily.

Re:Show HN: A shell CLI tool powered by LLM and RAG (include... by cheeseisinsane on Tuesday April 16, 2024 @07:58PM (#40058849)
To make the best of LLM and RAG, the need for more data is required. Our next step will be focusing on enhancement of data protection and security through the integration of good frameworks such as guardrails and others in our system, while maintaining a promising performance in the task.
Re:Show HN: A shell CLI tool powered by LLM and RAG (include... by huangyz0918 on Tuesday April 16, 2024 @08:39PM (#40059136)
Maybe add local LLM support
Re:Show HN: A shell CLI tool powered by LLM and RAG (include... by cheeseisinsane on Tuesday April 16, 2024 @09:18PM (#40059359)
of course. will add that in a short future