Re:Re-Evaluating GPT-4's Bar Exam Performance
by Jensson on Monday June 03, 2024 @08:21AM
(#40561966)
> At worst, it's more like a freshman-level answer
That is garbage.
Re:Re-Evaluating GPT-4's Bar Exam Performance
by randomtoast on Monday June 03, 2024 @08:30AM
(#40562030)
I hope you don't hold a teaching position at a university then.
Re:Re-Evaluating GPT-4's Bar Exam Performance
by Jensson on Monday June 03, 2024 @10:41AM
(#40563083)
I did, the growth students have from first to second year is enormous. Everyone know freshmen produce garbage answers, that is why they are freshmen and not out doing work, they are there to learn not to produce answers. If freshmen answers were good enough people wouldn't bother hiring college grads, just hire dropouts and high school grads.
> I hope you don't hold a teaching position at a university then.
You think teachers shouldn't have growth mindset for students? I think students can grow from producing garbage answers to good answers, that is what they are there for. An LLM however doesn't grow, so while such students are worth teaching even though they produce garbage answers the LLM isn't.
Re:Re-Evaluating GPT-4's Bar Exam Performance
by randomtoast on Tuesday June 04, 2024 @03:23AM
(#40571593)
> You think teachers shouldn't have growth mindset for students? I think students can grow from producing garbage answers to good answers, that is what they are there for.
I think many students including freshman have interesting and sometimes thought provoking ideas. And they come up with creative solutions, which is based on their previous experience in life. I would never describe that as garbage.
I've heard that claim many times, but never is there any specific follow-up on which topics they mean. Of course, there are areas like math and programming where LLMs might not perform as well as a senior programmer or mathematician, sometimes producing programs that do not compile or incorrect calculations/ideas. However, this isn't exactly "garbage" as some suggest. At worst, it's more like a freshman-level answer, and at best, it can be a perfectly valid and correct response.