News for hackers. Stuff that matters.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by Fomite on Thursday March 16, 2023 @05:39PM (#35189085)
Turns humans from writers into fact checkers, which it turns out is a harder skill.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by up2isomorphism on Thursday March 16, 2023 @05:44PM (#35189147)
It is actually much harder skill. And what worse is that any successful check makes the future checks harder. But there might be no significant improvement on the quality, just the difficulty of detecting the fallacy.
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by zamnos on Thursday March 16, 2023 @06:03PM (#35189413)
What sort of facts are you thinking of? There are plenty of surface level facts that another model or a human should easily be able to verify as true or not. Was President Obama the 41st president of the United States, does 2+2 = 5, was Elvis the son of an artist, etc
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style... by Fomite on Friday March 17, 2023 @12:28AM (#35193127)
In my sort of informal "How would I like to use this?" testing, this ranges from easily verifiable facts (i.e. "Did you get where I got my degree right?") to structural misunderstandings of important concepts.

The former would be easy enough to fix - though it undermines the utility and if not caught could carry ramifications for people, but the latter genuinely concerns me.