Re:Advanced NLP with SpaCy
by jakderrida on Saturday September 09, 2023 @10:15AM
(#37445708)
Quite honestly, I'd imagine getting LLMs to generate regex solutions seems most feasible. Regex can basically run through a character vector full of millions in impressive time. Plugging all of them into an LLM and awaiting a response taking 20 seconds each might be impractical for most use cases. However, asking an LLM to pack the regex statement full of synonyms and | operators just might seem a better solution. Especially if you can give the LLM some samples of what you're looking for.
They have different trade offs in the solution space.
I have no doubt that prompt engineering will eat into a bunch of work that was previously done using NLP though - particularly for prototyping.