News for hackers. Stuff that matters.
Re:Show HN: Cape API – Keep your sensitive data private whil... by gavinuhma on Tuesday June 27, 2023 @10:29AM (#36493361)
Yep! The more you can do locally the better. An entirely local LLM is the best for data privacy and security. Any time data leaves it poses some risk.

The de-identification itself requires a complex language model, which has its own complexity and costs to operate. At Cape we're going as far as we can to offer a secure API that's self-serve and easy to use to make these feature accessible to developers, but it does require trust in Cape and the underlying AWS Nitro Enclaves that we use. Client-side attestation is a security feature that can help provide cryptographic verification to the client of the secure enclave. But local is always better when possible!

Re:Show HN: Cape API – Keep your sensitive data private whil... by dbesemer on Tuesday June 27, 2023 @10:41AM (#36493544)
I will add that running your own private LLM is complicated and costly; and that private LLM (at this point) will not be as capable as GPT-4. So while running a private LLM will certainly be the right solution for some, Cape's offering makes improved privacy available to many.