Re:Things are about to get a lot worse for Generative AI
by pixl97 on Saturday December 30, 2023 @10:32AM
(#38815991)
I guess my next question is how many needles do you find and how sharp are they? Detection rules would filter out most of the noise, then something like an LLM would do a post filter for intent analysis to rank relative risks for human intelligence to look at.
[ Parent
| on HN ]
Re:Things are about to get a lot worse for Generative AI
by jcgrillo on Saturday December 30, 2023 @10:59AM
(#38816207)
I suspect this would disincentivize operators to take care in the way they write their detection rules, and the nondeterminism of the LLM would then result in false negatives. So the rate of growth of the needles set would increase, and the analysts would be getting lower quality information mediated by the LLM.
In a world where false negatives--i.e. failing to detect a sharp needle--are the worst possible failure mode, approximations need to be handled with exceeding care.