News for hackers. Stuff that matters.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @05:11AM (#26900525)
I'm sympathetic to the concerned individual threatened and harmed by corporate lawsuits, but I don't think I share the underlying concern.

> In Linkletter’s view, customers and users were not getting the whole story. The software performed all kinds of invasive tracking, like watching for “abnormal” eye movements, head movements, and other behaviors branded suspicious by the company. The invasive tracking and filming were of great concern to Linkletter, who was worried about students being penalized academically on the basis of Proctorio’s analysis.

In an in-person invigilated test environment, the invigilator/proctor is watching students carefully for suspicious movements and behaviours. We don't call that an invasion of privacy. While I don't like commercial proctoring software (I have to use some, not Proctorio, for students who can't enter the country because of Covid-19), being videoed by a machine while you do a test is a) not much different from everyone else in the class who's being watched in person (you probably get watched less, actually), b) a way to make sure essential academic standards are upheld. No one is going to get penalised based on some fallible "AI" system; "suspicious" events get reviewed by a person and usually aren't suspicious at all.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by fxtentacle on Thursday April 22, 2021 @05:24AM (#26900600)
"She then reviewed the flagged sections of the video with her university's dean, who she says agreed that her conduct throughout the test had been honest. This, however, did not resolve the situation. The dean, she explained, said she might still need to re-take the exam."

https://www.insider.com/viral-tiktok-student-fails-exam-afte...

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @05:32AM (#26900652)
That's the dean's mistake. This kind of software categorically does not detect cheating, and cannot be relied solely upon; only a staff member can make that decision. For example, I had one student using proctoring software whose father came into the room during the test, and I as the supervising staff member recognised the event for what it was and ignored it.

I don't much like such software, but I accept the current need for it. The problems people are describing seem to be faulty staff behaviour, not software.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by fxtentacle on Thursday April 22, 2021 @05:40AM (#26900703)
The software will automatically block your screen, meaning you cannot finish the exam if it accidentally activates.

"I was on the second question of an exam composed of 45 questions and I got a black screen. I'm still waiting to see what's going to happen as this is my final......... I tried to access the exam but was locked out and when i went to the exam the chat option wasn't available either. I emailed my professor and unfortunately, he wasn't watching the exam at the time and couldn't do much to help me out."

https://www.reddit.com/r/UBC/comments/g2ub05/god_kicked_out_...

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @06:07AM (#26900907)
The software sounds faulty. The black screen is terrible UX; it should just silently set a bookmark and let the student continue.

The overall outcome (and the student's experience and stress) is ultimately a staff issue.

The professor should have been on call, and should have been able to get the student back into the questions, or, failing that, to offer another sitting. I have done both of these, among other remedies, and setting student expectations ahead of time is crucial for avoiding massively stressful problems (stuff like "If something goes wrong, stop and email me. I can add lost your time back and get you into the test again, no matter how long it takes to sort out. You won't lose marks from this." and actually follow through). Software inevitably fails sometimes, and it is just a tool. Staff need to make their own decisions.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cycomanic on Thursday April 22, 2021 @06:24AM (#26901059)
You are correct this is a staff failure, the failure lies in using the software in the first place.

If we agree that the current situation is so exceptional that we need to fully monitor all students taking exams (and that's still a big if, I also am a university teacher, we don't use any monitoring system. There are other solutions as well such as taking oral exams...), one could simply hire a bunch of proctors who watch the video feed. Considering the savings that universities have made they could send one to everyone's home even.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @06:41AM (#26901186)
Copy-pasting from my other comment:

> I see it as a currently-necessary annoyance, as the least bad option. The alternatives have greater deficiencies: human invigilators using Zoom etc. don't scale (institution experience); oral exams don't scale (my experience moderating such assessments); no invigilation leads to cheating (by few students but enough to be a real problem, especially for professional qualifications - my direct experience and institution experience); shutting down education until the pandemic's over is unfeasible.

Last year, we tried not monitoring, we tried Zoom invigilation, we tried orals. Lockdown rules prevented us from sending in-person invigilators in one semester (and we couldn't have hired even 10% of what that would take) and the other we invigilated in person like normal. We are spending more than ever before, so there are no savings. All of these methods failed. This year, grudgingly, we have moved to proctoring software.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cycomanic on Thursday April 22, 2021 @09:12AM (#26902354)
I find your statements in different parts of the thread quite contradictory. On one hand you say that things don't scale because of number of students, but then a bit down thread you mention it's not worth making a new course for 10 students (out of 640), but for 10 students in person proctoring is clearly not a problem. You also mention the issue of cheating for professional qualifications, but again, that's a tiny fraction of all exams.

Regarding scaling of oral exams, there's actually some interesting research/calculations (I try to find the reference later) and the cross-over is somewhere around 150 students when oral exams become slower (I do think this is quite teacher and subject dependent though).

Also about budgets, I believe that your department is spending more than ever, the issue is property services departments of the universities should be saving large amounts. Considering lock-downs and staff and students working from home, maintenance cost should be way down. I suspect though that money lands in completely different buckets (don't get me started on the business of university property services, we pay rent in our overhead cost when we get grants that are higher than renting office space on the main shopping street in our city).

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @05:52PM (#26908632)
Well I'm talking about decisions about different things by different people 1) running exams (institution level - run centrally), 2) creating bespoke purpose-designed online courses (mostly department level). The decision about exam invigilation was made at the institutional level, where 10 is a small number of online students for a course, and they have dozens of courses to worry about. For most of the institution's courses, other solutions don't scale, and for the institution as a whole they definitely don't. The course with 10 online students may only run online this year, and it takes hundreds of additional hours to make a purpose-designed online course (we're doing that for other courses where the material will be reused).

The oral exams I moderated didn't seem like they could scale past 20 students. The reason our online students are online is almost always because they are overseas, and the majority of them have limited English. In that context, orals are discriminatory, stressful, and very slow.

I'm in NZ. Our universities have mostly been operating in person as normal (i.e. costing just as much) with far fewer international students (who bring in money), except in addition we have comparatively small numbers of resource-intensive online students as well, and are attempting to bring parts of entire degree programs online for the first time.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cycomanic on Saturday April 24, 2021 @04:07PM (#26927889)
Hah! I did my PhD in NZ and became a part kiwi (I still miss it to be honest). I'm back in Europe now, in Sweden and as you might know we have had a very relaxed (and very weird from a non-Swede perspective) approach to the pandemic. So we did have in-person and online exams, but all with proctering via zoom.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by scrollaway on Thursday April 22, 2021 @07:09AM (#26901376)
The bar to use such invasive, buggy, user hostile spyware should be a lot higher.

Just because this solves your problem (it clearly doesn't) doesn't mean it's a good idea. Killing half the students also solves your problem.

You need to live in a world where this is not an option, period. What's the next solution then? People forget there are always more manual solutions even if they take more time...

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by aravindet on Thursday April 22, 2021 @07:26AM (#26901496)
> human invigilators using Zoom etc. don't scale (institution experience)

Could you explain further why this did not scale?

I'm imagining an invigilator watching video feeds using an interface similar to, say, that used by security guards to monitor surveillance feeds. I would think that a single human invigilator can monitor more students using this system than an in-person setting. What am I missing?

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @08:10AM (#26901812)
In person, a single proctor can monitor 200+ students; our eyes capture far more detail and field of view than computer screens, and our peripheral vision is tuned for detecting unexpected motion. With Zoom, either you have one meeting with everyone in it, in which case students can look directly at each other, or you have a separate meeting for every student, in which case you need a large number of devices, all visible at the same time. I can't see the former scaling past 49, and I can't see the latter scaling past 20. If you had some software designed specifically for this and several big screens, it would still be pretty hard to pay anywhere near as close attention as you can in person.

On top of that, there's always a bunch of annoying mucking about getting set up for Zoom invigilation: angle of camera, light, checking environment, etc. All that needs communication to and fro, and it can take up to 5 minutes for a single student. Now multiply that by say 100 (a bit of parallelism is possible, but individual communication is needed with each student).

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by michaelt on Thursday April 22, 2021 @11:49AM (#26904120)
So get more proctors.

Given the cost of college courses, schools could easily afford $5 per student per course, and $100 for proctoring 20 students for a single exam is more than fair.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by amcoastal on Thursday April 22, 2021 @07:13AM (#26901396)
As both a TA and a student during the virus, we did better and so can you. Stop trying to shoehorn your in person lesson plans and exams into virtual and design new material and tests. Dont be a shitty teacher just because you're too lazy to change your now dated ways.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by dang on Thursday April 22, 2021 @01:22PM (#26905306)
Please make your substantive points without swipes. Crossing into name-calling and personal attack is not cool.

https://news.ycombinator.com/newsguidelines.html

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @07:26AM (#26901493)
Please don't make assumptions or resort to baseless insults.

We have designed entirely new fully-online interactive courses in response to this.

In other courses, where we have e.g. 640 local students and 10 online, they need to sit the same test for it to be fair.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by amcoastal on Thursday April 22, 2021 @07:40AM (#26901591)
Sounds like you need to design an online version of that course if you're going to allow online students to take it.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cycomanic on Saturday April 24, 2021 @04:18PM (#26927975)
While I disagree with the OP on the use of proctoring software saying something like "just design an online version of the course" displays a massive ignorance of academic workloads. Designing a new course, especially one which works online, is a huge amount of work, who is going to do all that? Most academics even in normal semesters work >50h (more likely >60h) per week.

Just adjusting your lecturing to online can easily take an additional 2h preparation per lecture, and often takes significantly more, because you have to also adjust all communications and how to make material available. That's even without redesigning the course for online learning. I know a lot of colleagues who got very overworked, because of the increased demand on teachers during the pandemic.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @07:48AM (#26901663)
The expense isn't justified for 10 students, since this may well be the only year that course is offered online. They are not getting a bad deal out of it. The fully new online courses are first year, and the expectation is that students will come to study in person for the remaining years of their degree. The other course I'm talking about is second year, but those 10 students can't get into the country at present - a temporary obstacle.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by moistbar on Thursday April 22, 2021 @08:42AM (#26902073)
> The expense isn't justified for 10 students, since this may well be the only year that course is offered online.

So instead you'd rather waste money on a barely-functional piece of software that actively invades your students' privacy?

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @10:18AM (#26903038)
It seems to function just fine (I'm not talking about Proctorio), and it doesn't invade privacy any more than the Zoom-based tutorials, which is barely at all. It is also better than any other alternative I know of, many of which have been tried already and found wanting. Privacy is not a god to whom all things must be sacrificed. All education involves losing a little privacy (in person people will know what you look like, where you're from, and many other things that are hidden for remote students; really they have more privacy than any others), and the fact that software is involved doesn't suddenly make things worse.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by moistbar on Thursday April 22, 2021 @10:37AM (#26903240)
>the fact that software is involved doesn't suddenly make things worse.

When that software is required to be installed on private machines and is difficult to remove, yes, it absolutely does make things worse.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @10:47AM (#26903367)
The software we use is easy to remove, and students have a lot of software installed on their private machines already, some of it more invasive in software terms (e.g. games with anti-cheating features). I have more qualms about the software and the privacy implications than the students do, and I'm resigned to it for now; the students just went ahead and installed it without comment.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by oxylibrium on Thursday April 22, 2021 @12:12PM (#26904438)
There's two problems with this statement. First is the assumption that students don't care about privacy, second is the lack of discussion about consent.

I'm a student who takes special care about the software I install on my laptop. I use a Linux distro, run primarily open-source software, and sandbox every single proprietary app (limited access to files, no admin at all, no screen recording, disabled webcam, ...). I've also looked into several of these exam spyware tools (you really are forcing students to install spyware), and they're built with often hilariously poor security practices.

Which is to say nothing of the regularly stolen source code; If you held the exam spyware solutions to the same standards that you held students to, you would write up almost every single vendor to the Academic Integrity office. Another example of hypocrisy in academia from the perspective of a disgruntled student.

I deliberately do not install any video games with invasive anti-cheating functionality (and I regularly critique them, like I do for exam spyware); that is a false equivalence anyway, since they don't deal in the same breadth of personally identifiable information (like a permanently saved panorama of my bedroom).

Don't assume all students are the same.

Second, the consent dynamics are wildly different. For a game, its like "you trade this in for fun/relaxation" - and there's always other games that don't spy on you. I play those. With universities, many pulled a fast one and introduced the spyware to students after their tuition is already paid, and said "use it or drop the course". You can't switch universities because one university didn't consider the ethics of spyware; you can switch games much more easily.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by moistbar on Thursday April 22, 2021 @10:51AM (#26903424)
Right, but that software was their choice to install, not forced upon them by their academic institution. It's good that it's easy to remove, but other people's computers are not your property.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by CRConrad on Friday April 23, 2021 @11:17AM (#26915589)
Why should this be the only year; why not join the 2020s and do the later classes online in the future too? If the students did their first year remotely they've already learnt to learn that way, so it should work even better with second- and third-year students AFAICS.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by fxtentacle on Thursday April 22, 2021 @08:10AM (#26901814)
I fully agree with you here that bugs in the software can be mitigated by having knowledgeable staff. But people can only be prepared for it if they hear about the issues beforehand.

That's why I find it so offensive that Proctorio is suing what appears to be university staff to silence them.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by sireat on Thursday April 22, 2021 @06:18AM (#26901011)
I am a lector at a University and would never force my students to install something that is so privacy invading as Proctorio on student's own computers.

If you absolutely need this type of monitoring it should be done at some sort of testing center on cleanly imaged computers. I could see it being done for something absolutely crucial such as a bar exam.

Proctorio and its ilk should not be used for simple mid-terms or even finals. This monitoring software becomes a huge crutch to lazy administrators and teachers. I should know I am lazy too.

PS While we are on the slippery slope, if Proctorio becomes standard we rapidly head to Snow Crash situation where federal jobs were heavily monitored. Already many freelancer sites use screenrecording software.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by jonathanstrange on Thursday April 22, 2021 @07:34AM (#26901549)
I hope that some security researchers investigate this software more closely and at the same time suspect that this lawsuit is primarily intended to scare away people from doing precisely that.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by oxylibrium on Thursday April 22, 2021 @10:27AM (#26903113)
"Security researcher" here: Proctorio's "zero-knowledge encryption" claims were in name only, pretty much.

TL;DR Canvas and Moodle use incrementing integers for both user ID and quiz ID. Proctorio's "zero-knowledge encryption" has a shared key derived from the two IDs; they store the user ID, so that's effectively a single PIN. With their older settings, you can brute force a quiz ID in a couple hours at most.

They increased the time cost for the brute force to now take days/weeks, but that's still peanuts and the attack scales really well, because most exams take place at the same time (students start/end at similar times), so once you crack the quiz ID for one record, that's tens-hundreds of records; and since IDs are just increasing numbers, once you find the lower bound, working your way upwards is much easier.

They also added an option for universities to use PGP keys - but that involves training faculty, or manual setup.

For more details, here's my blog article: https://proctor.ninja/wave-rake-proctorio

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by christophilus on Thursday April 22, 2021 @07:20AM (#26901447)
> I could see it being done for something absolutely crucial such as a bar exam.

Why? How did we ever produce lawyers in the past without Proctorio?

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by elliekelly on Thursday April 22, 2021 @11:56AM (#26904222)
The legal profession's dirty little secret is that the bar exam doesn't really matter. It's little more than a rite of passage and a good excuse for law firms to wait before bringing in the needy newbies before the summer associates have left. Cheating on the bar exam would present a serious character and fitness issue but not having the requisite knowledge to pass the bar exam would not at all impact a person's ability to practice law.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @07:23AM (#26901463)
In person exams. In a pandemic, that can be a problem.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @07:22AM (#26901456)
If you have a testing centre you don't need this kind of software, and if your students are scattered across the world due to Covid-19 travel restrictions, you can't have a testing centre for them. I consider invigilation absolutely crucial in a professional engineering degree in mid-terms and finals (engineers are more likely to hurt more people than lawyers). I don't think this kind of software is a crutch for the lazy; it's more work to organise and manage than human invigilators, and doesn't scale as well.

I don't think it's a slippery slope. We will have significantly more local students than remote for the foreseeable future, and the local students are invigilated in person. We have students wanting to opt into remote study, including using this software, but so far if they're local we tell them no (except under extreme circumstances).

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by sireat on Thursday April 22, 2021 @09:17AM (#26902394)
We will have to agree to disagree then. The whole term invigilation is a bit dystopian.

It is a huge slippery slope because this privacy invasive software ends up being used for such mundane things like weekly quizzes.

Do you really want to live in the future/present where we have to submit ourselves to daily monitoring?

How about adding some monitoring via sensors of performance boosting substances?

My answer is that such monitoring software should be only used under exceptional circumstances on neutral computers - my example was a testing center with insufficient human supervision.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @10:09AM (#26902946)
I think you're extrapolating way too far, and hence your arguments aren't hitting the mark. The total amount of invigilation in the entirety of each course I'm involved in is 3-5 hours. This has been the case for many decades. This year, for some students, it is aided by software, due to the fact that they're unavoidably thousands of kilometres away. It is not a slippery slope, and none of your dystopian ideas seem like they could result from it.

This kind of software does not monitor computer use outside of the test. It monitors the student during the test, like a human invigilator (yes, it's recorded, so not identical). During the test, the student is only working on the test, which is not private or secret. When the test is finished, the software exits.

I don't see how you could have the resources for an infrequently used testing centre, but not enough to pay one person for an hour or two. That is not what this kind of software is useful for.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by oxylibrium on Thursday April 22, 2021 @11:32AM (#26903890)
> During the test, the student is only working on the test, which is not private or secret.

You fail to consider the circumstances in which the test takes place. Students take the test in their personal spaces, and earlier in the thread, you mentioned essentially inspecting a student's living space (...angle of camera, light, checking environment, etc...) "Checking environment" is really just a cold, "process" word for inspecting a student's living space.

A student's room can often have private or secret things about them. Before you ask, not every student has the privilege to use a separate, clean, blank room to take tests. A personal space is inevitably going to have personal, private things. I've brought this up before; I personally know friends who were outed to professors as trans because their personal space has things like needles - and then you even have stuff like naive professors assuming "drugs" when its really just medications.

It could be anything else besides that, in fact - calendars with things scribbled on them; family photos; posters for political organizations; if you look in someone's bedroom, you're inevitably going to find out things about them that they would rather you not know.

Would you take your students on a tour of your bedroom while you're teaching an online class?

EDIT: In addition, there's non-traditional students and high risk students, and interruptions in general - there's not _only_ a test going on - I've had someone from my family interrupted in the middle of an exam because someone from the government knocked the door to take our temperatures and ensure we're healthy and don't have COVID. There's always more things going on, too.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by initplus on Thursday April 22, 2021 @05:32AM (#26900656)
If your software is ethical, why smear your own name by bringing a spurious lawsuit against a singled out individual like this?

There are real concerns around privacy with software like this - what will happen if some criminal finds an exploit in Proctorio's software? This kind of monitoring software is often designed to be hard to detect or bypass, and installs itself in ways that are challenging to remove. Development of this kind of software should be done with a high degree of caution and care. There isn't a risk that an invigilator will be compromised by a malicious actor, and then see every detail of students lives and all their private data for all time. But this risk does exist for software.

If Proctorio takes legal action like this against critics what does that say about their software?

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @06:27AM (#26901092)
Agreed, the lawsuit is a terrible thing to do full stop, and doesn't seem to make business sense either. Maybe they think his critiques are worse than the bad press.

I agree about the privacy concerns, and in normal circumstances I wouldn't use proctoring software, because all my students would be local (or they would have signed up as distance students knowing this kind of thing would be needed). I would also have much less issue with it if it was open source.

I see it as a currently-necessary annoyance, as the least bad option. The alternatives have greater deficiencies: human invigilators using Zoom etc. don't scale (institution experience); oral exams don't scale (my experience moderating such assessments); no invigilation leads to cheating (by few students but enough to be a real problem, especially for professional qualifications - my direct experience and institution experience); shutting down education until the pandemic's over is unfeasible.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by necovek on Thursday April 22, 2021 @07:33AM (#26901541)
> no invigilation leads to cheating (by few students but enough to be a real problem, especially for professional qualifications - my direct experience and institution experience);

How is it a real problem (I've never cheated but always felt I got fair grades, not affected by whatever cheaters did)? If a student memorizes everything they need for the exam today, but forget all of it tomorrow, is that useful? That's a very real thing happening every day in exams, and nobody highlights it as as big a problem as cheating (I think it's a bigger problem actually, but the solution is not necessarily in finding those who can do that, but in optimizing the material so memorization is not such a core part of it before you start specializing).

In careers where such things really matter (think medicine), people only progress by demonstrating actual knowledge and understanding while gaining real-life experience. We don't get a surgeon out of a medical school that hasn't shadowed a surgeon and been quizzed on things to do next.

It's similar with engineering: you are given smaller, simpler things when you start off, and you build up your knowledge and experience before being given the role of a lead engineer for an airplane engine.

Exam grades are never used as a measure of someone's knowledge on the topic, though a paper they authored, or their dissertation, naturally, might.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @07:41AM (#26901601)
It's a problem for institution reputation, and for remaining accredited to confer professional degrees controlled by external organisations, like engineering degrees.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cassalian on Thursday April 22, 2021 @07:01AM (#26901319)
> I see it as a currently-necessary annoyance, as the least bad option... shutting down education until the pandemic's over is unfeasible.

Is it necessary though? Have you considered there are ways other than testing for a student to demonstrate their knowledge on a subject? Projects, presentations, and writing all come to mind as effective ways to measure knowledge on a subject and do not require treating all students like cheaters because a few choose to do so.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @07:39AM (#26901586)
Yes, but my subject is maths :-). 1st and 2nd year engineering maths don't really have projects, presentations, or writing as options, as we mostly care about whether they know particular fundamental mathematical techniques and skills. All those options also have the problem of knowing who did the work.

From talking to remote students, I don't think they feel like they're being treated like cheaters. Instead, they seem happy we're making their study possible, and accepting of what they're asked to do. They know it's important that they can demonstrate unequivocally that they have particular skills.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cassalian on Friday April 23, 2021 @07:23AM (#26913525)
My sister is still in school and the anti-cheating software gives her a lot of anxiety - not that she's a cheater or anything, but because it is well known that this software flags non-cheaters as cheaters. For example, she is not allowed to look around or talk to herself while working on a problem, both of which help her to demonstrate her knowledge effectively. If the goal is for testing to demonstrate a student's knowledge, then employing techniques that hinder a student's ability to do so in the hopes of catching cheaters is counter productive to the original goal. After all, you want to know if she can apply fundamental techniques and skills - not whether she can apply these fundamental techniques and skills while behaving under a very strict set of rules.

Even in early level mathematics, there are plenty of opportunities to introduce word problems that can only be solved by applying the relevant techniques. As long as the teachers are defining these word problems themselves (rather than pulling them from an online resource), they stand as a pretty good guard against cheating since they require students to first recognize the technique that needs to be applied, and then to extract the relevant variables from the word problem to apply that technique.

Furthermore, in early level mathematics, you can still have students present solutions to problems and explain why the solution works. For instance, say you were interested in whether or not a student has grasped the basics of derivatives - simply get on a call with that student, give them a random function to solve the derivative for, and then have them do so in front of you.

These are all things I've quickly thought of that would have at least be partially effective in measuring knowledge. I imagine any person with a career dedicated to instructing students could come up with many more options that could be even more effective.

> Instead, they seem happy we're making their study possible, and accepting of what they're asked to do. They know it's important that they can demonstrate unequivocally that they have particular skills.

Students are happy to be able to study and know that it's important to demonstrate their skills - but that doesn't mean that they wouldn't be happier if they could demonstrate their skills without the invasive testing software. I argue this is setting up a false choice: "you can either learn nothing at all, or do so under this cheating software". But the reality of the situation is that they can still learn and demonstrate their skills without the cheating software.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by geoduck14 on Thursday April 22, 2021 @06:39AM (#26901175)
Isn't Dominion suing Ted Cruz?
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by jbarberu on Thursday April 22, 2021 @09:51AM (#26902712)
As far as I know they're suing Fox News, Mike Lindell, Sidney Powell and Rudy Giuliani for defamation.

Not sure what your point is, but the difference between "dead president Hugo Chavez flipped votes for Biden" vs "Here is how the software works, I don't think it's right" is quite important.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by cycomanic on Thursday April 22, 2021 @06:18AM (#26901004)
You make two assertions that are both clearly incorrect. Your point a) there clearly is a difference between watched (not filmed) in class and a software, filming you, recording audio, monitoring everything you type and what your computer is doing _in your own home_. Saying there is no difference is akeen to stating a police officer watches you in public, so let's install cameras in everyone's home. b) you say that nobody will be penalised by based on an AI system, despite there being lots of reports of exactly that happening (some where even posted a bit further up thread).
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by noisy_boy on Thursday April 22, 2021 @05:34AM (#26900666)
What the invigilator sees, stays in his/her head. They are not recording things with their eyes; this software is doing that (I'm not sure of the extent, how much is client side vs server side, anonymization levels etc). However, I'm making that assumption based on the fact that if a person disputes something, a recording of the event would be required to ascertain the facts. That kind of information can be damaging in case of security breach; e.g. someone could have a habit of picking noses when lost in thought or changing clothes during the exam (they might reasonably do that in their home and not in a public exam with invigilator present). If such videos leak due to security breaches and catch circulation on internet, the people in them can be subject to ridicule or invasion of privacy online.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by JDW1023 on Thursday April 22, 2021 @05:17AM (#26900557)
People can have different expectation of privacy at home versus in classroom/testing facility.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by tobr on Thursday April 22, 2021 @07:20AM (#26901443)
> being videoed by a machine while you do a test is a) not much different from everyone else in the class who's being watched in person

> "suspicious" events get reviewed by a person

Being taped and having that tape scrutinized after the fact is not equivalent to being in the same room as an invigilator. I could accept a live video call as being roughly equivalent, but not if it’s recorded.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by anfilt on Thursday April 22, 2021 @05:15AM (#26900541)
It's their personal computer though.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by anovikov on Thursday April 22, 2021 @05:15AM (#26900540)
But i think it's OK to install the software just on a laptop you'd use to take tests, some old laptop, and keep yourself free of surveillance otherwise right? If so, i can't see how is it a problem: someone absolutely has to be watched while taking a test. But if it's during whole education process, then yeah, it's ridiculous and worth fighting against.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by DoreenMichele on Thursday April 22, 2021 @05:23AM (#26900591)
But i think it's OK to install the software just on a laptop you'd use to take tests, some old laptop, and keep yourself free of surveillance otherwise right?

That's a fairly classist assumption that someone has multiple devices, including some older piece of junk that's late model enough to be useful for test taking but still essentially a "throw away." It implicitly means that adequate right to privacy is only reserved for wealthy kids and not for anyone who only has one computer.

That's not to suggest that I support this assumption even in cases where it's true. I'm just trying to point out a common blind spot that leads comfortably well-off people to often act with callous disregard towards those who have less because it isn't a big problem for themselves.

Re:EFF sues Proctorio on behalf of student falsely DMCA'd by daemin on Thursday April 22, 2021 @05:21AM (#26900572)
For some people "some old laptop" is all they actually have. I don't imagine a lot of students have both a desktop, a laptop, and "some old laptop" that they can use, so the software will get installed on the single computer they use (or share) to get their studies done on.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by eythian on Thursday April 22, 2021 @05:21AM (#26900574)
Not everyone has an old laptop lying around they can use for such a purpose.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by mkl on Thursday April 22, 2021 @05:23AM (#26900597)
The software is only running during the test. Most students install it on their main laptop, and they don't seem to have much problem with that. It runs with elevated privileges (so it can make sure it's the only program running), and it's proprietary, both of which I have objections to, but unless I'm missing something and Proctorio is quite different from the software I've used, I don't see much problem with it. In Covid-19 times everyone puts up with things they don't like.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by anovikov on Thursday April 22, 2021 @05:45AM (#26900734)
OK then at all, i can't see the problem. Unless there is a reasonable suspicion that it's malware and infects your machine with something that still keeps tabs on you when it's as if not running.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by em-bee on Thursday April 22, 2021 @05:24AM (#26900603)
it's pretty unrealistic to expect everyone to have a spare laptop around.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by GordonS on Thursday April 22, 2021 @02:21PM (#26906094)
Assuming you have enough RAM, I guess you could run it in a VM.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by 2pEXgD0fZ5cF on Thursday April 22, 2021 @04:44PM (#26907966)
Programs like this usually attempt to detect and forbid being run in a VM.
Re:EFF sues Proctorio on behalf of student falsely DMCA'd by em-bee on Thursday April 22, 2021 @08:44PM (#26909833)
instead, an actually workable solution would be dual booting. that only needs some disk space.

only downside is that it's a bit tricky to set up if you want to dual-boot two windows systems.