News for hackers. Stuff that matters.

A comment on Ask HN: Is anyone doing anything cool with tiny language models?. Parent comment

Re:Ask HN: Is anyone doing anything cool with tiny language ... by indolering on Wednesday January 22, 2025 @06:24AM (#42791570)
Y'all definitely need to cross validate a small number of samples by hand. When I did this kind of research, I would hand validate to at least P < .01.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by kaspermarstal on Wednesday January 22, 2025 @06:59AM (#42791817)
She and one other researcher has manually classified all 7000 papers as per standard protocol. Perhaps for the next article they will measure how this tool agreed with them against them and include it in the protocol if good enough.
[ Parent | on HN ]