News for hackers. Stuff that matters.
Re:Show HN: Savvy – Create, Share and Run Runbooks from your... by mspaint_exe on Wednesday May 29, 2024 @07:13PM (#40518224)
This would be great at work, but most orgs would never allow some terminal app to connect out to an LLM we've never heard of and have no understanding of the privacy of, especially for difficult to quantify efficiency gains.

Would you ever consider a version that allows redirecting to a locally hosted LLM server?

Re:Show HN: Savvy – Create, Share and Run Runbooks from your... by joshi4 on Wednesday May 29, 2024 @08:41PM (#40518872)
I'm currently using GPT4-o via OpenAI's API.

I've been looking at ollama for a bit and I think I will ship an integration with Savvy at some point.

For enterprises, I think it makes sense to support a company approved LLM API endpoint in addition to local LLMs.

I'm happy to answer any questions you have around privacy too.