News for hackers. Stuff that matters.
Re:Fine Tuning Mistral 7B on Magic the Gathering Draft by pixl97 on Tuesday December 05, 2023 @03:58PM (#38536813)
How much additional calculation occurs in high-stakes decisions by individuals. Also what is the variability in quality of high stakes decisions in humans?

I'm guessing LLM decision is rather average, but that the LLM has no easy way of spending the extra time to gather information around said high stakes decisions like a human would.

Re:Fine Tuning Mistral 7B on Magic the Gathering Draft by s1artibartfast on Tuesday December 05, 2023 @07:19PM (#38538843)
I dont think additional calculation is the difference. It makes more sense to think of individual humans as models which are highly tuned.

Just like like LLMs, some humans are better tuned than others for specific tasks, as well as in general.

Re:Fine Tuning Mistral 7B on Magic the Gathering Draft by nicbou on Wednesday December 06, 2023 @04:53AM (#38542109)
The difference is that you can reject a low-stakes answer that's invalid. You can tell that something is off, or it doesn't matter.

With high-stakes decisions, you're surrendering the decision-making power to the AI because you don't understand the output well enough to verify it.

Basically, and AI can give ideas but not advise.