News for hackers. Stuff that matters.
Re:Advanced NLP with SpaCy by pharmakom on Saturday September 09, 2023 @04:57AM (#37443462)
We still use regex despite there being LLMs that can approximate this functionality

They have different trade offs in the solution space.

I have no doubt that prompt engineering will eat into a bunch of work that was previously done using NLP though - particularly for prototyping.

Re:Advanced NLP with SpaCy by jakderrida on Saturday September 09, 2023 @10:15AM (#37445708)
Quite honestly, I'd imagine getting LLMs to generate regex solutions seems most feasible. Regex can basically run through a character vector full of millions in impressive time. Plugging all of them into an LLM and awaiting a response taking 20 seconds each might be impractical for most use cases. However, asking an LLM to pack the regex statement full of synonyms and | operators just might seem a better solution. Especially if you can give the LLM some samples of what you're looking for.