Re:Advanced NLP with SpaCy
by jerrygenser on Saturday September 09, 2023 @08:12AM
(#37444422)
LLM are not somewhat fast when measured against CPU models in spacy that are specialized for a task. They are multiple orders of magnitude slower for e.g. token classification/NER, text classification, etc.
LLMs are somewhat fast, somewhat accurate, and not cheap.
Basic NLP techniques can be faster, more accurate, and cheaper.