News for hackers. Stuff that matters.
Re:Advanced NLP with SpaCy by janalsncm on Saturday September 09, 2023 @05:14AM (#37443524)
Usually businesses want fast, accurate, and cheap.

LLMs are somewhat fast, somewhat accurate, and not cheap.

Basic NLP techniques can be faster, more accurate, and cheaper.

Re:Advanced NLP with SpaCy by jerrygenser on Saturday September 09, 2023 @08:12AM (#37444422)
LLM are not somewhat fast when measured against CPU models in spacy that are specialized for a task. They are multiple orders of magnitude slower for e.g. token classification/NER, text classification, etc.