News for hackers. Stuff that matters.

A comment on Ask HN: What is the right way to fuse my enterprise data with an LLM?.

Re:Ask HN: What is the right way to fuse my enterprise data ... by Terr_ on Tuesday December 03, 2024 @12:06AM (#42303209)
I think an important baseline question is how much you care when the user of the LLM forces your model to divulge sensitive details or large chunks of that data.

Imagine that the LLM portion is running as client-side browser JavaScript application: Nothing in the training data or prompt is reliably-secret, and a determined user can get it to emit almost anything they like to whatever is downstream.

[ Parent | on HN ]
Re:Ask HN: What is the right way to fuse my enterprise data ... by uptownfunk on Tuesday December 03, 2024 @04:19AM (#42304362)
That is a valid constraint. For us we don’t really mind if it emits anything sensitive we are more concerned that it is correct.
[ Parent | on HN ]