News for hackers. Stuff that matters.
Re:Show HN: LlaMaKey – One master key for all cloud LLM/GenA... by xy-li on Thursday February 15, 2024 @02:03PM (#39386916)
Amazing project!

I really appreciate this simple and good idea to manage API keys/tokens in the era of LLM. Personally, I'm often anxious about the safety of my own keys/tokens across several platforms. Recent news about some open-source projects that abuse the secret keys also recall me of the leakage concern. More details can be referenced in this post https://gist.github.com/win3zz/0a1c70589fcbea64dba4588b93095... and a relevant paper: https://arxiv.org/abs/2309.02926 Many risks are avoidable if the developer team deploys their service properly. I believe a good tool like this project is also an in-demand solution to reduce the concern and burden during their R&D stage.

Re:Show HN: LlaMaKey – One master key for all cloud LLM/GenA... by forrestbao on Thursday February 15, 2024 @02:47PM (#39387595)
Thank you very much! Appreciate your comment and encouragement.

I conceived this idea while working on a project with multiple people to evaluate multiple LLMs. Too many API keys floating here and there in the code. So I said, what if we could use only one master key for all the APIs and hide the real key from users. Then, LlaMakey was born.