The exams were incredibly difficult for bad reasons: you had to calculate many iterations of an algorithm by hand. You also had to memorize a bunch of algorithms (rather than understanding how they worked or how to modify them to solve different problems).
The professor also had a "can't do anything about it" attitude, and so the entire class was blatantly cheating as a result, and I got the worst grade of my academic career.
It sort of broke the camel's back for me; I consider our current approach to academics to be fundamentally broken.
It's harder to design exams where people cannot cheat, but it's certainly possible. Randomize the orders of questions on the test. Have multiple versions the same question (e.g. in a math exam, change a 2 to a 4, or a sin to a cos). Now you have unique exams for each student.
Most importantly, design questions that require critical thinking, and allow everyone to use their computers/books/notes/whatever. That's far more representative of real life anyway.
These simple changes would both make cheating very difficult, and result in better learning: memorizing a bunch of crap the day before an exam will have basically no impact in my life. Learning how to reason critically about the subject matter will give me lasting benefits, even if that subject never comes up again.
This ProctorU stuff is just quadrupling down on a fundamentally broken approach and making it much worse.
We were allowed calculators too, but the problems were designed that anyone even mildly good at mental math didn't need them. In theory you could teach all of calculus without ever even using numbers (perhaps except 0).
Yes.
It's been so long since I took calculus but that's the reason why we weren't allowed calculators in my Calculus class. All the formulas needed for the test were also provided (as we weren't being graded on our memorization skills either)
My professor also said don't bother doing simple arithmetic just to simplify an answer - leave it at 12/56 or whatever.
Turns out, it was a really, really great system.
Mathematica, on the other hand...
Lets see if the kids know how to multiply fractions:
factorial(256) times ( 1 divided by factorial(256) ) equals ?
And yes, there will unfortunately be kids trying to brute force it by typing it in instead of cancelling the factorial(256).
I think the 89 is awesome for algebra because typing in an equation and doing an ans(1) with an operation will let you do the algebra process without making stupid arithmetic mistakes. I wish someone made a calculator that does this only and not one that does all the other CAS tricks for integration and derivatives. Oh and I wish they would make it RPN but that is a whole other story.
Another common trick: looking at your keyboard isn't cheating. Any small display secreted on your keyboard will go unnoticed. You will just look like you aren't a great typist, someone who needs to look at the keys.
Want to go real hardcore? Cut into your laptop and send the screen/keyboard/mouse signals to a different monitor. Then you can have an actor sit in front of the webcam pretending to take the test. I doubt they are correlating keypress sounds to characters appearing on the screen... yet. As any security expert would tell you: if the attacker has unfettered access to your hardware then all bets are off.
I had such a numerical methods exam, I had a python script ready for it. No regrets on automating something that should be automated. I understood how the method works and wrote code for it.
We were allowed (and encouraged) to write cheatsheets for most of our exams at university. However, they had to be a single sheet and handwritten.
The reasoning was that in the process of creating a cheatsheet, students would reinforce their learning. The handwriting requirement was to encourage us to write them ourselves, instead of just printing one off, and the size requirement was so that we had to think about how to distill a semester of learning instead of just trying to copy the entire textbook by hand.
I really liked the system, and I feel like it did help more than just allowing open book exams. I remember of the few exams that were open book (some even allowed us to use the internet, but with a ban on communicating with others), I usually got a worse grade, as I ended up putting less effort into studying.
https://nakedsecurity.sophos.com/2011/03/09/a-complicated-ca...
I memorized a lot of information, but I still search just as often on google and stackoverflow whenever I needed to check something.
It also help that I don't try to memorize a bunch of a crap before an exam.
He convinced one professor, possibly two, but if he had any more luck than that, I wasn’t in those classes with him.
Most of what we do is synthesizing facts into knowledge. But I know from copious personal experience that there is a wide grey area between recalling a fact at will and forgetting it exists entirely. I am fairly good at recalling concepts in general terms. Y might be applicable in this case, but I need to check the details to be sure/explain how.
Which is also why I think banning computers from planning meetings is stupid. You want us to agree to do things without being able to spot check any of our hunches that will drastically effect our estimates? That’s a winning plan /s.
My school's CS department defaulted to allowing students to use almost any available resource (unless specifically indicated otherwise). But you were required to write down what resources you used.
So a professor might assign a whole pile of nasty algorithm proofs, and say, "You're allowed to work in groups to find the general solution. But you need to write down your group members, and you need to do your own writeups." Tests were in person but not especially proctored. The penalty for cheating was a heavy suspension and a transcript annotation, with permanent expulsion for a second offense.
This actually worked pretty well, back in the day.
That’s such a strange response to that expectation. For the class I teach, I made my exams open book, open notes, open internet and gave them a extended time to work on the exam. If they’re gonna cheat, they’re gonna cheat. Don’t fight the tide. But the questions I asked where analysis/synthesis questions that couldn’t simply be looked up, and student performance was on a bell curve with a 80 average (in line with previous years). I think a lot of professors need to embrace the situation and adapt rather than forcing a police state on students during exam times.
Cheating is never OK. Look what that lead to. A few bad apples ruined it for the other students. People have to learn, that their behavior in such a setting does not only affect themselves. In this case it very negatively impacted everyone studying with them.
at some point it's like defensive driving. Sure, they are at fault and an idiot, but for the sake of your own safety you shouldn't "stick to your morals" or just "hope they get theirs". Look out for yourself, because for some people that's the only person that will do it.
With that lens, yes. I don't blame people who need to do what they do for one day in some artificial environment so they aren't impacted in their transition to real world work where they are otherwise moral.
Except, for many competitive positions, that's a zero-sum game.
In india, the engineering curriculum includes lot of subjects that are not useful for the students but only there because some fat belly officer thought it would be "Interdisciplinary".
Can you imagine teaching biology as a subject for engineers? waste of money and not what we have come to learn, or interested in. But colleges in India do that.
Cheating in such subjects is fair.
Their solution was to let us use whatever we wanted except other students. Cellphones, textbooks, laptop, Internet.
You had 2 hours to answer 2 or 3 questions, it was definitely reasonable if you studied... But the questions were insane.
You know how homework would be assigned 1-50 odds? These were like the problems 74 and 76, 1/4 page long and difficult, multiple parts.
That seems as similar as engineering school got to the real would outside our sophomore and senior design projects.
Yeah, it's crazy that cheaters are the protagonist of the ban e-proctoring story.
What if the university only admitted students who don't cheat?
How do we know that policy works for real at a place like Caltech?
Academic culture is accommodating, and you feel that way too. But universities must know that cheating harms everyone, it's a losing proposition. The right response should have been to suspend grading.
It’s a common fallacy to attribute behavior to innate qualities of people, rather than situations.
Personally, I removed exams entirely in the last courses I taught in Spring 2020, and it seemed to work out OK. I had no faith that the proctoring systems would catch everything, and I had no desire to inflict them on my students in any case.
One variety was legal - you’d have a doctors note to get a reasonable accommodation for ADD. In the 90s, it was pretty trivial to do that. Once you had that, you were taking tests in a facility that made cheating very easy (open book) if you were motivated.
The idea was that the A section was the basic plug-n-chug versions of the problem that everyone should be able to get if you were even half paying attention in class; the B section is stuff that requires a bit more reasoning and analysis, and may have a pitfall or two, but they'll be things that were at least mentioned; and the C section is effectively extra credit— a problem where you needed to have a deeper understanding in order to figure out something novel about it, or like you needed to re-derive something from first principles in a way that was slightly different from what was shown in class, that kind of thing.
And the sections weren't equally weighted; I think it was usually like 50/30/20, or even 60/30/10.
Some people hated this, but I really liked how explicit it was. There was no mystery meat— the whole evaluation scheme was very open about its design and intent.
On one hand I really like the former approach and could understand the latter (organizing resits is likely a huge PITA). On the other that's the only professor I heard of that was attacked with an axe by one of his students.
How did that end, if it's not too weird to ask
> normalizing the lab scores between different reviewers
Sounds like a good idea to me :-)
I had experience taking undergraduate courses at 4 institutions in the USA and of course many departments.
I had some professors that expected the grades to fall like grade school did with 90-100 % being a high percentage. Others gave 4-6 difficult multi part problems and graded on a transparent curve. Others gave difficult problems and were not transparent about the grading scheme.
But let's look at the reality of a student at a normal institution or trying to get into college today; it's a series of high stakes exams that decides your future. And a prisoners' dilemma since as soon as someone cheats you have to do it as well just to keep up. This used to be high risk high reward but now, thanks to the pandemic, it suddenly became low risk high reward. No wonders everyone is doing it.
Really, it's a great equalizer. Pre-Pandemic, it was a common strategy to get "diagnosed" with ADHD to get extra time during exams. But for that you needed well connected parents. Now everyone can cheat.
I beg to differ. Saying that dishonesty is acceptable in certain scenarios will only motivate them to further partake in bad acts. In extreme cases, the child will end up as a criminal.
these are university students pressured to have high grades for internships/first jobs, not some impressionable elementary schooler. Thinking way too obtusely for this to be a factor and compare this to some middle schooler getting into drugs.
The good news is I think that with classes being in person again things will go relatively back to normal. Honestly I don't think I can fault students who cheated during the pandemic, it was just so abnormal that most people did whatever they had to to cope.