Re:Show HN: Get your unstructured data AI-ready in minutes
by sabrina_ramonov on Tuesday May 28, 2024 @12:07PM
(#40502200)
I'm curious what types of sensitive data you scan for, besides personally identifiable information? For example, how do you scan for IP that might be custom to an enterprise?
[ Parent
| on HN ]
Re:Show HN: Get your unstructured data AI-ready in minutes
by joewferrara on Tuesday May 28, 2024 @12:27PM
(#40502500)
that's a good question. for this use case, we have a custom models feature where the user can define an entity type (types) they're interested in and then a custom ner model is trained to identify the specified type. for this, a combination of llms and user input are used to generate training data for the ner model.