News for hackers. Stuff that matters.
Re:Fighting Fire with Fire: Scalable Oral Exams by eaglefield on Friday January 02, 2026 @02:48PM (#46468602)
At the price per student it probably makes sense to run some voluntary trial exams during the semester. This would give students a chance to get acquainted to the format, help them check their understanding and if the voice is very intimidating allow them to get used to that as well.

As an aside, I'm surprised oral exams aren't possible at 36 students. I feel like I've taken plenty of courses with more participants and oral exams. But the break even point is probably very different from country to country.

Re:Fighting Fire with Fire: Scalable Oral Exams by trjordan on Friday January 02, 2026 @03:06PM (#46468791)
They mention this at the end of the article:

> And here is the delicious part: you can give the whole setup to the students and let them prepare for the exam by practicing it multiple times. Unlike traditional exams, where leaked questions are a disaster, here the questions are generated fresh each time. The more you practice, the better you get. That is... actually how learning is supposed to work.

Re:Fighting Fire with Fire: Scalable Oral Exams by skywalqer on Friday January 02, 2026 @02:52PM (#46468638)
At my university (Charles University in Prague), we had oral exams for 200+ people (spread over many different sessions).
Re:Fighting Fire with Fire: Scalable Oral Exams by baq on Friday January 02, 2026 @03:08PM (#46468809)
> spread over many different sessions

this is also known as 'logistical nightmare', but yeah it's the only reasonable way if you want to avoid being questioned by robots.

Re:Fighting Fire with Fire: Scalable Oral Exams by saltmate on Saturday January 03, 2026 @08:10AM (#46476178)
Ah yes, the logistical nightmare any hair salon or nail studio handles just fine.
Re:Fighting Fire with Fire: Scalable Oral Exams by baq on Saturday January 03, 2026 @02:29PM (#46480545)
these shops do nothing but 'exams'. no teaching, no research, no papers, no students. comparison is valid for ~2 weeks in a year, maybe.
Re:Fighting Fire with Fire: Scalable Oral Exams by eaglefield on Friday January 02, 2026 @02:57PM (#46468695)
Impressive!

I think the most I experienced at the physics department in Aarhus was 70ish students. 200 sounds like a big undertaking.

Re:Fighting Fire with Fire: Scalable Oral Exams by Arodex on Friday January 02, 2026 @02:56PM (#46468683)
>As an aside, I'm surprised oral exams aren't possible at 36 students.

It depends on how frequent and how in-depth you want the exams to be. How much knowledge can you test in an oral exam that would be similar to a two-hour written exam? (Especially when I remember my own experience where I would have to sketch ideas for 3/4th of the time alloted before spending the last 1/4th writing frenetically the answer I found _in extremis_).

If I were a teacher, my experience would be to sample the students. Maybe bias the sample towards students who give wrong answers, but then it could start either a good feedback loop ("I'll study because I don't want to be interrogated again in front of the class") or a bad feedback loop ("I am being picked on, it is getting worse than I can improve, I hate this and I give up")

Re:Fighting Fire with Fire: Scalable Oral Exams by andrepd on Friday January 02, 2026 @08:41PM (#46471881)
Of course they are possible! But it would take a fraction of a day's tuition to pay for a TA to do it, so they want to make a god damn chatbot to do it... Good lord.

They're even more possible if you do an oral exam only on the highest grades. That's the purpose, isn't it? To see if a good, very good, or excellent student actually knows what they're talking about. You can't spare 10 minutes to talk to each student scoring over 80% or something? Please

Re:Fighting Fire with Fire: Scalable Oral Exams by bccdee on Friday January 02, 2026 @09:50PM (#46472307)
Oral exams scale fine. A TA makes $25 per hour, and an oral exam is going to take an hour at most. I absolutely would not accept a $25 tuition rebate in exchange for having my exam administered by an LLM.
Re:Fighting Fire with Fire: Scalable Oral Exams by fn-mote on Saturday January 03, 2026 @09:45AM (#46477248)
But you'll accept the results of an exam for a (in the US) $1000+ course given by a TA that makes about the same as a delivery driver? And you'll trust their assessment of the results? There's so much wrong with this idea, I don't even know where to start.
Re:Fighting Fire with Fire: Scalable Oral Exams by bccdee on Saturday January 03, 2026 @10:07AM (#46477509)
Obviously the session should be recorded & transcribed. If you take issue with your mark, you can escalate it to the professor, same as you would for a written exam.

If you're looking for suggestions, I'd love for you to start with a problem that isn't trivially fixable.