Re:LLMs can label data as well as human annotators, but 20 t...
by coldtea on Sunday June 18, 2023 @06:20PM
(#36385131)
Only 20?
[ Parent
| on HN ]
Re:LLMs can label data as well as human annotators, but 20 t...
by dimava on Monday June 19, 2023 @02:44PM
(#36395012)
The report states humans take ~60s per answer and GPT-4 takes ~3.0s, thus just 20 times time / 7 times cheaper is the baseline for the highest quality result available.
Faster models are 2-3 times faster, but 3s is already enough even for real-time application
The cost, hovewer, goes down to 1/1000 for cheaper models (and they can still 100% some of the datasets), meaning that for the same price as a human annotator you could have 1000 parallel realtime LLM annotators