Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by atleastoptimal on Monday March 13, 2023 @04:37PM
(#35142175)
"initial human evaluation" is codeword for "cherrypicked prompts given to people who don't know how to trick an LLM"
[ Parent
| on HN ]
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by sebzim4500 on Monday March 13, 2023 @05:10PM
(#35142717)
I don't understand why that is a bad thing. If your goal is to make an AI assistant, then you should be optimizing for giving answers that real users find useful, not trying to impress other AI researchers.
Re:Stanford Alpaca, and the acceleration of on-device LLM de...
by ChubbyGlasses on Monday March 13, 2023 @05:12PM
(#35142746)
i always found this to be a strange pov to have on LLMs. imo, it's not humans tricking/gaming the ai, but rather chatgpt has tricked you into believing it's smarter than it actually is. (in human terms, chatgpt is just more articulate than llama)
it's a subtle distinction, but i think it shapes and reflects how you view ai as a tool for humans or as a replacement.