News for hackers. Stuff that matters.
Re:Remote scan of student’s room before test violated his pr... by Claude_Shannon on Friday August 26, 2022 @03:38AM (#32604301)
It is terrible, but what is the alternative to prevent cheating? I had quite a few on-line exams by now and I've seen very creative attempts at cheating so far.
Re:Remote scan of student’s room before test violated his pr... by p1necone on Friday August 26, 2022 @03:59AM (#32604457)
Design better tests. If you can "cheat" on a test by just googling things/looking at notes then the test isn't testing anything but rote memorization anyway.
Re:Remote scan of student’s room before test violated his pr... by gommm on Friday August 26, 2022 @04:06AM (#32604513)
Exactly, I strongly believe that any test at a secondary education level should be open book. We should be testing for reasoning and capacity to apply knowledge not rote-learning.

It's also why I believe that in most cases multiple choice questions have no place in any well designed tests because it's extremely hard to create multiple choice questions that actually test the application of knowledge versus the regurgitation of rote learning.

When I was in university (grande école) in France, luckily all tests followed that format, they were open book, very few questions that needed deep detailed answers and were about interesting problems. Even finding tests from previous years and doing them was actually fun (tests were never reused).

I did an exchange in the US at RIT and most tests had very boring rote learning questions. For example in a computer graphics class: Which company were voting members of the OpenGL Architecture Review Board? Which year was the first OpenGl specification released?. I still remember those questions because I was shocked by how utterly stupid it was to have those on a test but, in general, 25 to 50% of the points of any tests was on those completely irrelevant, useless questions that anyone can google for.

Cheating is a problem for universities that never had proper testing standards. But that's a symptom of incompetence on the part of professors and of universities not making the choice to ensure that tests have to be well designed.

Re:Remote scan of student’s room before test violated his pr... by p1necone on Friday August 26, 2022 @04:13AM (#32604579)
I've seen some very hairy multi choice questions in Math/Computer science (think testing order of operations, which function gets called due to complicated polymorphism etc). I think it depends on the subject.

Although I also encountered a few where multiple answers were technically correct. Then you have to guess at which answer the professor thinks is "more correct" which kinda sucks.

Re:Remote scan of student’s room before test violated his pr... by gommm on Friday August 26, 2022 @04:21AM (#32604631)
Yeah, another decent alternative I've seen was a test with a few multiple choice questions where each question needed quite a bit of reasoning and where you had to give the reasoning to get the points. The multiple choice question was a way for the teacher to quickly know if you had the correct answer and for the student to verify their answer against possible answers and see if they might have made a mistake but the teacher would still need to review the half a page of reasoning for each question.

It can be done decently but it's much easier to write and much more common to see bad multiple choice questions.

Re:Remote scan of student’s room before test violated his pr... by connicpu on Friday August 26, 2022 @05:43AM (#32605178)
In one of my Math/Computer classes in college, part of the class was that along the way you were supposed to be implementing the mathematical concepts in code along the way, so that you would have your code available to run on the test questions when it reached the day of the test! Whether you programmed on a TI-89 calculator or your laptop was up to the student, but the tests were open note and open device and it felt very freeing. The actual methods of input and exact algorithms were of course carefully picked so that there would be no easy off the shelf code solution, but once you understood it the problems could be trivially implemented in any programming language with a BigInt type
Re:Remote scan of student’s room before test violated his pr... by tpetry on Friday August 26, 2022 @04:18AM (#32604607)
One of the bests I had written in university allowed you to bring every non-digital material you want to have. All slides? The books? The former exercises? No problem! The test was designed to be built on 2 primitives:

1. If you need to lookup stuff in your waste of material you won‘t be able to finish everything. The time constraint was very hard. 2. It was not just repeating former things, you had to have understood them. Everything was a transfer knowledge exercise.

Re:Remote scan of student’s room before test violated his pr... by NotOscarWilde on Friday August 26, 2022 @04:54AM (#32604830)
> If you need to lookup stuff in your waste of material you won‘t be able to finish everything. The time constraint was very hard.

Did you enjoy this exam? I am asking as I had a very similar experience in my undergrad:

Our university allowed some basic courses to be studied at different departments, if they were equivalent. This means that there was a CS Major Algebra 1, but also Math Major Algebra 1, and you can take either.

I took the Math Major Algebra 1, being a CS student, and I have passed everything up to the final exam, where I learned that the exam is literally what you describe. All the proofs and arguments needed follow from basic principles (as things in Algebra 1 tend to do), but there is a lot of questions and the time limit is strict.

Thus, you have no time to actually do any deliberate thinking, you have to memorize and understand the basics so well that you can develop the arguments essentially in real time.

(And it was not an open book exam, even, but as you describe, it would not have helped you too much.)

I hated that exam. I never took it out of principle, instead just quitting the course and doing it with a great grade a year later, in CS. I still dislike the idea of forcing knowledge acquisition through strict time limits. What if somebody is smart but has a slow start due to stress? Ugh.

Re:Remote scan of student’s room before test violated his pr... by matheusmoreira on Friday August 26, 2022 @08:28AM (#32606512)
> If you need to lookup stuff in your waste of material you won‘t be able to finish everything. The time constraint was very hard.

Reminds me of my school days. Tests with hundreds of questions and less than a minute to solve each question. They were essentially testing the student's time management skills as well as their physical and mental fortitude in addition to their knowledge. Extremely exhausting and anxiety inducing.

Re:Remote scan of student’s room before test violated his pr... by matwood on Friday August 26, 2022 @08:38AM (#32606619)
I hated take home tests in undergrad and grad school because they were the hardest tests I took. Memorization was easy lol.
Re:Remote scan of student’s room before test violated his pr... by rtev on Friday August 26, 2022 @04:05AM (#32604501)
While preparing for a certification, I had someone DM me on the prep forums and offer to ship me an in-ear monitor and physical HDMI mole to coach me in real-time. Cheaters are nuts, there are few test formats that would survive an attack like that.
Re:Remote scan of student’s room before test violated his pr... by PeterStuer on Friday August 26, 2022 @04:14AM (#32604583)
It's not just googling . It's communicating with others. In a no checks environment you can have an a la carte team of paid consultants and helpfull friends solving the test with you.
Re:Remote scan of student’s room before test violated his pr... by klabb3 on Friday August 26, 2022 @06:54AM (#32605703)
Bingo! [Surprised I had to scroll so far to find this.] You can discuss the merits of rote learning and test design all day, but cheating exists within any pedagogic paradigm. Back in my day, most cheating was between students doing each other favors or taking a small commission.

The way some teachers solved this was a 1:1 oral complementary exam, where students were asked to explain a random set of their solutions. This is drastically more difficult to cheat in real time, and you will almost certainly look like an idiot if you come unprepared. It's a stupidly simple solution, disincentivizing cheating through shame. Doesn't need any proctoring rootkits and rectal cameras, a simple identity check is enough.

Re:Remote scan of student’s room before test violated his pr... by janekm on Friday August 26, 2022 @04:20AM (#32604622)
and... where's the problem? That's exactly the kind of group problem-solving that is actually required in the real world.
Re:Remote scan of student’s room before test violated his pr... by detaro on Friday August 26, 2022 @04:57AM (#32604852)
that if I hire someone for skills with X, I dont want their skill to be "I can ask people with skills with X what to write".
Re:Remote scan of student’s room before test violated his pr... by blitzar on Friday August 26, 2022 @04:24AM (#32604651)
apparently 'im really good at google search' wasnt the answer someone was looking for in an interview
Re:Remote scan of student’s room before test violated his pr... by KingOfCoders on Friday August 26, 2022 @04:01AM (#32604470)
A math professor (granted easier with math) at university always said, you can bring anything you want to the exam, if you can answer it with help he made a mistake designing the test.

I see the same when I interview people online and I hear them frantically click their keyboard - but no help, I know before what Google returns.

Re:Remote scan of student’s room before test violated his pr... by p1necone on Friday August 26, 2022 @04:04AM (#32604496)
Trying to evaluate a software engineer without letting them use google strikes me as being similar to trying to evaluate a construction worker by making them dig holes with their bare hands.
Re:Remote scan of student’s room before test violated his pr... by KingOfCoders on Friday August 26, 2022 @04:11AM (#32604560)
I'm not asking things that can be solved by Google [1], because they can be solved by Google, and I only gain the knowledge "Candidate can Google", I see this as given. It doesn't mean that not a lot of work at the job involves googling Stackoverflow - I do it myself all the time.

[1] I don't ask API knowledge, if someone doesn't know some API I tell them just to invent the call they need.

Re:Remote scan of student’s room before test violated his pr... by tpetry on Friday August 26, 2022 @04:20AM (#32604621)
Add 1-2 questions which can be googled. I have seen enough engineers not earning the „can efficiently google“ badge.
Re:Remote scan of student’s room before test violated his pr... by saalweachter on Friday August 26, 2022 @07:47AM (#32606095)
I got dinged on that test once. "Why didn't you just Google this question?" they asked, "Because I was taking a test," I said.
Re:Remote scan of student’s room before test violated his pr... by zimpenfish on Friday August 26, 2022 @04:17AM (#32604597)
Best technical interview I ever had, they sat me down in front of an internet-connected laptop, gave me some problems on a piece of paper, and said "we'll be back in an hour, do your best". Just left me alone with Google et al.

(Then I spent an hour-ish talking to swardley about 3D printing and its future impact on IP law, etc. -- this was back in early 2007, before it was generally available. That was the weirdest non-technical interview I've had.)

Re:Remote scan of student’s room before test violated his pr... by PeterStuer on Friday August 26, 2022 @04:19AM (#32604614)
Did any student show up with a 5G tablet and an earpiece?
Re:Remote scan of student’s room before test violated his pr... by KingOfCoders on Friday August 26, 2022 @04:57AM (#32604854)
No but there were some were I suspected someone was listening in and answering questions.
Re:Remote scan of student’s room before test violated his pr... by Alex7845 on Friday August 26, 2022 @09:57AM (#32607592)
Students typically don't cheat in online tests by looking at their notes. What they do is ask other students or have someone else do the exam for them.
Re:Remote scan of student’s room before test violated his pr... by jonfw on Friday August 26, 2022 @07:58AM (#32606196)
“Design better tests” is not useful feedback. It’s just kicking the can down the road and blaming professors
Re:Remote scan of student’s room before test violated his pr... by IshKebab on Friday August 26, 2022 @04:02AM (#32604477)
Ok how do you design a test that's so good I can't just pay someone else to take it for me?
Re:Remote scan of student’s room before test violated his pr... by titoCA321 on Friday August 26, 2022 @03:49AM (#32604379)
Students and teachers have been cheating before pencil and paper. Do you ever wonder why some college students have near-perfect SAT scores yet can barely rub two English words together?
Re:Remote scan of student’s room before test violated his pr... by systemvoltage on Friday August 26, 2022 @03:52AM (#32604401)
No, it is not acceptable that we have to give up privacy for some stupid exam cheating problem. There are going to be lots of problems and inconveniences like this. We have a legacy of 250 years of constitutional protection of privacy.

Solve the fucking problem without violating privacy. If it doesn't get solved, fine, let it be. Accept those consequences and live with it.

Re:Remote scan of student’s room before test violated his pr... by Teever on Friday August 26, 2022 @03:39AM (#32604308)
Take home tests are a thing.

I've never had one, but from what I've heard they're the kind of thing that if done properly ends up being a better way to test people, but they're harder for instructors to implement.

Re:Remote scan of student’s room before test violated his pr... by Claude_Shannon on Friday August 26, 2022 @03:46AM (#32604350)
I guess so. Most of the tests I;ve taken at college were the same tasks as in previous years, just with changed numbers. ... or not. That also happened.
Re:Remote scan of student’s room before test violated his pr... by blitzar on Friday August 26, 2022 @04:27AM (#32604663)
Exam questions have to be approved, re-use the old one and it sails through. Write a new one from scratch ... takes time.

Typically you just use the questions from ~5 years ago and rotate them through.

Re:Remote scan of student’s room before test violated his pr... by smabie on Friday August 26, 2022 @03:43AM (#32604333)
You've been able to take online classes for decades, why is this suddenly a problem?

Moreover, if people want to cheat they can find some way to cheat regardless of any countermeasures you deploy.

Re:Remote scan of student’s room before test violated his pr... by thrdbndndn on Friday August 26, 2022 @03:49AM (#32604377)
>which [why?] is this suddenly a problem?

Because most of teachers didn't teach online class before. They are not used to design exams that would not be way too easy it suddenly becomes open book.

I won't even say they're "lazy", coming up good take-home exams is super hard, especially when you spend your entire career not need to do that.

> if people want to cheat they can find some way to cheat regardless of any countermeasures you deploy.

I agree if it's online exam, it's kinda doomed either way. But it's more to act as a deterrent than total solution. And it does work to some "less-adventurous" students.

Note: above is just directly replying to your questions. I don't support scanning student's room.

Re:Remote scan of student’s room before test violated his pr... by titoCA321 on Friday August 26, 2022 @03:53AM (#32604410)
Come on now, some of the college instructors weren't even teaching the offline classes. 200 students in a lecture hall and some random TA grading and assigning the tests. Do you honesty believe the TA knows each and ever student and that someone else didn't show up on exam day?!
Re:Remote scan of student’s room before test violated his pr... by PeterStuer on Friday August 26, 2022 @04:09AM (#32604537)
At every university that l took exams photo id was required to sit the exam.
Re:Remote scan of student’s room before test violated his pr... by swores on Friday August 26, 2022 @05:52AM (#32605251)
I'd guess that people who are willing and able to afford hiring someone to cheat for them in an exam, can probably also order a fake ID with their name and the photo of their exam-taker.

Though maybe an extra step of storing a copy of the ID with the exam entry and having a professor who knows them verify that it matches the real student would catch most of that...

Re:Remote scan of student’s room before test violated his pr... by cguess on Friday August 26, 2022 @10:23AM (#32607919)
Where? In the US I've never had to do so.
Re:Remote scan of student’s room before test violated his pr... by PeterStuer on Wednesday August 31, 2022 @04:32PM (#32667977)
Not in the US. EU.
Re:Remote scan of student’s room before test violated his pr... by geek_at on Friday August 26, 2022 @06:11AM (#32605403)
> if people want to cheat they can find some way to cheat regardless of any countermeasures you deploy

I was a Academic highschool teacher for 8 years and I agree with your statement but also don't think that we should make it too easy for them. At minimum a screen recorder so the students know even if they were not caught during the exam, they could later be caught

Bonus anecdote When the first bluetooth phones hit the market we had students use their (pseudo) smart phones (that looked like expensive calculators with greyscale displays back then) to send each other the solutions during the physics exam. No teacher at the time had this as a threat model

Re:Remote scan of student’s room before test violated his pr... by trashtester on Friday August 26, 2022 @06:49AM (#32605655)
At some point, when a student find a truly novel way to gain an advantage, that can be seen as a kind of creativity, and may point to a strong career (hopefully within the law).

However, if lots of students cheat in the same way semester after semester, the school has a credibility problem.

Re:Remote scan of student’s room before test violated his pr... by yoro46 on Friday August 26, 2022 @03:45AM (#32604344)
Take home tests that are difficult enough for the questions to not be easily answered on Stack Exchange or paid sites. This is fairly easy to do in upper-division undergraduate courses as well as graduate courses. Not so easy for lower-division courses. The closest I've seen for a lower-division class was a professor who made as much of the exam content based off examples from lecture material, but I always saw that as a way to punish students who ditched lectures.
Re:Remote scan of student’s room before test violated his pr... by sh4rks on Friday August 26, 2022 @03:54AM (#32604413)
The best way to prevent cheating in an online test is to set a strict time limit. That way its harder for them to look up the answers on Google etc. The problem then is that a student may experience technical difficulties out of their control. For cases like that, students should be able to appeal for extra time.
Re:Remote scan of student’s room before test violated his pr... by jamesrr39 on Friday August 26, 2022 @04:09AM (#32604547)
This might work for things you have to remember off the top of your head, where you have e.g. 10 seconds to write answer, but it doesn't really work when you have longer questions requiring some kind of working which take more than a minute to work out.

I also think that the "extra time for technical difficulties" is going to be very hard to prove or disprove and would lead to very arbitrary decisions.

Re:Remote scan of student’s room before test violated his pr... by PeterStuer on Friday August 26, 2022 @04:07AM (#32604514)
But this introduces a stronger bias for being fast regardless of wether you cheat or not. That is not always what you want.
Re:Remote scan of student’s room before test violated his pr... by Broken_Hippo on Friday August 26, 2022 @05:16AM (#32604961)
They already do this with some tests, both online and in person. If it isn't generous enough, it generally harms folks that are being careful with answers while cheaters can cheat. The cheaters just have to be prepared.
Re:Remote scan of student’s room before test violated his pr... by pabs3 on Friday August 26, 2022 @04:06AM (#32604512)
Another question is; what is the alternative to tests, grades and credentials?