Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style...
by zamnos on Thursday March 16, 2023 @06:03PM
(#35189413)
What sort of facts are you thinking of? There are plenty of surface level facts that another model or a human should easily be able to verify as true or not. Was President Obama the 41st president of the United States, does 2+2 = 5, was Elvis the son of an artist, etc
[ Parent
| on HN ]
Re:Show HN: Alpaca.cpp – Run an Instruction-Tuned Chat-Style...
by Fomite on Friday March 17, 2023 @12:28AM
(#35193127)
In my sort of informal "How would I like to use this?" testing, this ranges from easily verifiable facts (i.e. "Did you get where I got my degree right?") to structural misunderstandings of important concepts.
The former would be easy enough to fix - though it undermines the utility and if not caught could carry ramifications for people, but the latter genuinely concerns me.