Re:Ask HN: No interest for my idea (private LLM and RAG for ...
by namanyayg on Wednesday July 17, 2024 @08:14AM
(#40984999)
Thanks for the comment. You're right about the tagline. I wasn't able to figure out something that's understandable and yet not overly technical. Can you elaborate on what would be a clear tagline for the app?
Regarding the privacy aspects: i should have made this clearer in the landing page, I also offer the option to use local/self-hosted llms through ollama. Thanks for the reminder, I'll update this soon.
Re:Ask HN: No interest for my idea (private LLM and RAG for ...
by danenania on Wednesday July 17, 2024 @01:15PM
(#40988077)
Something like “Use AI with your company’s private data” maybe that makes it clearer what the app does. That’s not amazing but something along those lines perhaps. And be sure to also explain what makes it unique, since there are many other products in the space. What makes your product different from all the others? Simplicity? Integrations? Whatever it is, try to really hone in on that.
Makes sense about the local models. Definitely a good idea to make that clearer imo.
Re:Ask HN: No interest for my idea (private LLM and RAG for ...
by namanyayg on Thursday July 18, 2024 @11:44AM
(#40996758)
Thanks for the advice, I'll make these changes
Beyond that, emphasizing privacy while also advertising your use of models from OpenAI, Anthropic, Google, etc., is confusing. In my understanding, the central challenge of enterprise “chat with your company data” is how to do it without giving the data to cloud model providers. Self-hosting the server where the model calls are made doesn’t address this at all and I think you may risk engineers and security people viewing this as misleading marketing as a result.