Re:The Rise of the AI Engineer
by pvman on Wednesday July 05, 2023 @05:37AM
(#36597959)
Thanks for the info z3c0. Have you implemented open source solutions? Do you mind sharing some deterministic solutions to detect entities without huge dictionaries (NER)? Or maybe extractive QA if you used that instead?
[ Parent
| on HN ]
Deterministic? Not anything that is "one size fits all". If your documents are of an unpredictable shape, then ML is your best bet. For both NER and QA, BERT models are very capable.
To your first question, most of my ML work is proprietary, unfortunately. I am hoping to change that in the near future.
Edit: spaCy is a great library for NER, if you're hoping for an open-source solution that can have you hitting the ground quickly. SQuAD for QA.