Look at any list of advice for new college students and almost every one of them includes "go to class". Simply attending class is way easier than homework and yet, when there's no short term consequences for not doing it, plenty of students will just not do it.
Cheating is another great example. Cheating in college is rampant because kids don't want to do the work they're assigned. I don't understand the logic behind the idea that if you tell all the kids currently using ChatGPT to write their essays, "Hey, you don't actually have to write that essay at all" that you think they will somehow choose to write it anyway. They're already choosing to ignore the long term benefits of homework even when there are short term consequences, so I don't see how removing those short term consequences will make things better.
If you tell kids there are no immediate consequences for not doing homework, many of them just won't do it and they will fail because they haven't learned anything.
Maybe you're okay with that. Honestly, I'm not actually trying to convince you that it's a bad idea. I just think if your proposal is based on the idea that kids will choose to something boring that they don't have to do in the short term because it benefits them in the long term you're overestimating a lot of kids (and adults for that matter).
We actually had this exact thing at my university. One sophomore level weed out class was a "self paced" electrical engineering class. It was called self paced because you were given a textbook and were free to work through it at your own pace. But to finish the class by the end of the semester you had to average 2 chapters completed per week, and completing a chapter not only included finishing a problem set and taking a test which you had to score 90%+ on (and were required to finish another problem set and retake it otherwise), but on occasion also demoing some skill in the lab.
It was brutal, but one of the most educational classes I've ever taken - and obviously not just because of what I learned about electrical engineering. Of course it seems modern universities have just become profit-driven degree treadmills. Weeding out students? That's reducing profit! And yeah looking back at my uni's page it seems this class is no longer self paced. Lol. And that's at a top 10 school. The enshittification of education.
Perhaps that begs the question, if those kids can’t handle self-directed education, why are we putting them there in the first place, but that’s definitely a grey area, and there are hundreds of thousands of students who are smart enough to do well in higher education and skilled work, but weren’t disciplined enough to handle what you’re describing as freshmen.
A teacher who thinks this way is probably in the wrong profession. A university that operates this way is failing to educate the students it admitted.
From my experience studying electrical and computer engineering, I definitely prefer that they chose to put hard electrical engineering courses in the first semesters because I knew immediately not to focus on them because I didn't like them.
Some students also just don't have the aptitude for an Engineering or Computer Science degree. It's better for everyone if this is figured out early. I know plenty of people that dropped out of a Computer Science degree because they hated it or thought it would be a great way to make money and were in over their head.
We had classes that were for 'weeding out' students in Computer Science. They involved calculus because if you couldn't pass this class, you wouldn't be able to handle the 5 or so classes after this class that required it.
I unironically believe if you tell all the kids they don't have to write the essay at all, much more will choose to write it.
Kids cheat not just because they're lazy. Cheating makes people feel smart. The fact you can get credits by doing very little while others work their asses off is rewarding and self-validating.
The big issue of exam-only approach is that a one-hour exam is not enough to evaluate a student's performance, unless your educational goal is just to make students memorize stuff by rote. I'd consider a 3-hour open-book exam minimal. But if every class does that it'll be too exhausting.
Fun prank: set all of the clocks in your dorm neighbor’s room to different wrong times. Guy across the hall knew we were messing with him, trusted his watch - which had the correct time, but wrong alarm time. Realized he had a problem when he had hot water in the shower and no one was around. He was only 45 min late to the exam. Good times.
He did fine in his exam. 3 hrs was overkill. Sometimes you can be your own worst enemy.
It was the 80’s. I guess kids these days are soft.
There needs to be a reward for doing essays. That reward can be emotional eg. "the teacher I respect liked my essay" or "my essay was read in class" or "the teacher gives feedback that makes me feel a sense of growth". In that case, maybe kids will do it.
However, I think it's hard for a teacher to inspire respect to a classroom and the difficulty scales with the number of people in the class, so grades are used as a hack.
You want me to don't know something? I better make sure to get to know everything about that. You push me to do stuff? Why should I care, if you already do.
I agree that open-book exams, or at least a closed-book portion followed by an open-book portion, is important to actually gauge the student's abilities rather than his/her capability to cram.
I am 100% certain quite a lot of people cheat because they procrastinated and don't have time to learn. Or because they indeed were lazy to learn. Or because they cant learn, because they course is too hard for them.
Or because video games and youtube are more fun.
So, you have 2 kids who are equally bright, and you tell one "you don't have to do these assignments but there is a test at the end" and the other "you have an 80% chance if failing if you don't do these assignments. Analyse each assignments and feedback for shiboleths like the way they ask you to structure your introduction and optimize for demonstrating you know these shiboleths over everything else"
University is a wonderful petri dish for growing into who you want to be. You have access to expertise and resources abs a certain kind of institutional credibility. Few students actually use these fully and the ones who do were told to. You need some idea who you want to be and why, and this is developed in you by other people. Children don't just know stuff.
I think these are positive changes if and only if we accompany them with systematic study skills and self management courses and bridge this gap.
I seriously doubt that. In my experience many students won't do anything that doesn't directly contribute to their grade.
With lecture notes/slides available online, well prepared books and study forums readily available - in-person attendance can feel archaic.
We may be experiencing a similar dynamic in education with AI. In a world where we can create individualized curriculum’s for each student encompassing the entire tree of knowledge - Perhaps it’s time to rethink how we educate students rather than push them into lecture halls designed for the Middle Ages.
People thrive under regularity, and young people (especially) tend not to understand that. Similarly, being able to focus on a single thing is a kind of super-power, while multi-tasking generally hurts performance on tasks.
Going to class (and paying attention) means that you've got a regular period of focus on the class topic. That combination of regularity and focus translates into long-term learning and better performance.
In a few of my classes, I have final projects that teams work on. I also have presentations. I used to require them of all students; and quickly learned this is a good way to waste valuable time.
Now, all my presentations are completely optional for NO CREDIT. You don't get penalized if you don't do them, and perhaps more importantly, I give ZERO EXTRA CREDIT for doing them.
As you can imagine, every single presentation I've gotten from this has been absolutely worth it.
Others had some pretty cool things that ended up in real life; I believe the official timers for the Florida Supreme Court testimony things came from one of my classes.
You can take that one step further. What kind of signal does “I can afford to go to University and not worry about credentials” send? I’d argue that’s realistic only for people who are willing to admit that they belong to a leisure class. In the US at least, we like to flatter the leisure class with the pretense that they worked hard to get there.
Maybe this is true of liberal arts or business degrees? I don't know, but I don't think this is the opinion of anyone who went to engineering school.
So this isn't all that crazy.
I think optional homework works for classes that are obscure enough only somewhat intrinsically motivated students would consider taking them, but in mandatory classes or trendy majors, there's going to be many people who need a bit more external motivation to study.
> AFAIK this was because under the old system, there had been too many students registering for exams despite being woefully unprepared, and then predictably failing as a result.
True. That's the real Dunning-Kruger problem: incompetent people do not know how much help they need to get competent. It is our job to show them their weaknesses as early as possible so that they can effectively work on them.
(I believe that state-funded universities (as in Germany) have some obligation to not only educate the self-motivated top 1% but also offer a solid education even for less perfect students - at least if there is a societal need for their competences.)
Another, more important, reason is that written exams are not good tests of programming competence - especially as tasks and frameworks get more complex. We want to assign good grades to students who are competent at developing software in realistic settings, not in highly artificial exam settings.
Of course, the paper by 'Dunning-Kruger' never showed anything like that.
From the abstract:
"Paradoxically, improving the skills of participants, and thus increasing their metacognitive competence, helped them recognize the limitations of their abilities."
All they found was a statistical artefact.
You can just have a look at the big picture at the top of the Wikipedia article: https://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
> Relation between average self-perceived performance and average actual performance on a college exam.[1] The red area shows the tendency of low performers to overestimate their abilities. Nevertheless, low performers' self-assessment is lower than that of high performers.
So regression towards the mean explain the entire effect.
See also https://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect#...
This is still very much compatible with my claim that unskilled people profit from being reminded (repeatedly, not just in the exam at the end of the semester) that they know less than they think. I will avoid conflating this with the Dunning-Kruger effect in the future (Thanks!).
An recent study found that medical students' estimate of their own intelligence gets lower right after taking an IQ test (confirming the better-than-average effect). But one week later, their self-estimated intelligence returns back to their pre-test levels. To me this suggests that students (and all others) will overestimate their abilities - and invest less time in learning - if they are not constantly given feedback.
https://www.sciencedirect.com/science/article/abs/pii/S01918...
many kids fail to make the transition from spoon-feeding to self-learning, but those who do then begin to realize that they can go as fast as they are able and need not follow the herd. they also develop a strong sense of whether they’ve understood each booklet or not. it leads to a competition for learning fast AND well because there are also traditional proctored checkpoint exams from time to time plus kids do the ordinary standardized tests to calibrate.
i feel it’s an excellent system that prioritizes learning over conformity though it is obviously not a candidate for mass adoption because many kids wash out after making no progress for a while.
Mind you, I don't really have any alternative suggestions.
Let's get real here. I know why these nonsensical memes keep propagating but dear god. People will just believe anything these days, including that gas stoves cause asthma or whatever other bullshit is being peddled.
But I'm not particularly brilliant, in fact I wouldn't be terribly surprised if I have undiagnosed ADHD. My test taking performance trick, which I freely told everybody to their annoyance, was very simple. I knew the material! Read the assigned texts, do the optional homework, pay attention in class. If you know the material you don't have to try to cram it into your brain in the last half hour before the test. If you know the material you don't have to try to reason it out from first principles during the test. You just go in, fill out the easy answers straight away, go back and do a second pass for the tricky questions, and that's it. If you have to sit there wracking your brain for 30 minutes on a single problem it's because you already fucked up with how you approached the course weeks ago.
Again, I'm not special for this. There were a handful of other students who were as fast as me. We'd sit in the hall waiting for our friends, look at each other and say "you knew all this stuff too, huh?" "yeah of course"
Bullshitting though tests is a learnable / trainable skill, but schools generally do not teach it very coherently or well and most students do not deliberately practice it. It generally doesn't have that much to do with the content or other skills intentionally taught by any particular course or by schools in general (there's decent overlap with the skills involved in competitive debate and extemporaneous speech, which some students participate in as an extracurricular activity). Rating students on how good they are at bullshitting their way through exams is sadly a significant part of the way our education system is focused and organized, but in my opinion it is not a valuable or particularly valid approach. There are certain professional contexts/tasks where this kind of skill is useful, but developing it per se shouldn't be the focus of the education system.
Sometimes this and related skills are summarized as "intelligence" ("oh she aced the test without studying, she must just be really smart", etc.), but in my opinion it's quite a misleading use of the word.
This is thing.
If this choice is between:
1. A gameable system that will be gamed by most students.
2. An ungameable system that will unfairly punish those bad under pressure and time constraints.
There isn't really a choice at all.
One option would be a school-provided proctoring system, allowing teachers to outsource the actual test-taking times. It could be done outside of class time, at the student's convenience, and they could have 3-4 hours if they chose.
Given modern communication technology it’s still gameable
And rates of cheating of "well under 1%" vs "well over 50%".
Even if we allow for less rigorous proctoring standards, we're still probably talking about "2-3%" vs "well over 50%".
Learning to perform under pressure is the main purpose of attending college.
But we could do what I'll call a "monastic exam".
You've got a week, not an hour, but it's in a little monastery and you don't have your phone or other unapproved tools.
I will say it's not practical to have exams that long. In this case, the dorm required me to move out immediately after the exam and my parents were waiting to pick me up, so I decided to leave after 4 hours to avoid unnecessary panic or having to drive overnight. In hindsight, the professor probably would have let me make a phone call, but that didn't occur to me at the time.
You have to get a special blue book with a couple blank pages and then write an essay with the prompt that's given at exam time. Then you turn in the book at the end of the exam. I think it's a great idea and was surprised more classes didn't work that way but I guess it's like you say: grading written assignments like this is a lot of work.
He wasn’t worried about llms, they were not around, but plagiarism. It worked well.
It’s also a disadvantage for people with test anxiety.
We run university programs at my company, and arrived at this bit of insight as well. That said, some of your points are incorrect or incomplete:
- You can't build systems assuming responsible individuals. These systems are guaranteed to fail. Instead, assume individuals are mould-able, and build a system which nurtures discipline towards goals. This works. - There are still issues with cheating, but it's more of an older way of thinking, that we developed methods to reset. - Advanced students need to be given more challenging assignments - quantum of assignments should be the same no matter the capability of students. This solution was unworkable until GenAI came about.
Looked from a pure individual skill-building perspective your ideas are alluring, but if one looks at completion rates of any online courses (Udemy/Coursera - under 4%), then one understands why physical cohort-led education system can work.
Happy to chat with anyone who'd like to delve deeper on this.
As someone with a 96+% 'failure' rate on Udemy/Coursera I honestly don't see the relevance of this statistic. Most people going to University are there primarily because they want/need the degree. That piece of paper is really valuable, perhaps even more so than the knowledge gained. The piece of 'paper' offered by Coursera/Udemy etc. has basically zero value, so the people taking those courses are doing it almost exclusively for the knowledge they offer. Once you've learned what you wanted to learn from the course there is very little incentive to go the extra mile and go for the 'completion'.
I understand how from an individual's pov what you said makes sense. Similarly I hope you understand why from the system's perspective: it's the effort that's mandated and not just the proficiency.
Employers and others (higher education orgs, etc) care a lot about sustained effort, alongside proficiency. Only proficiency-focused systems (like Udemy/Coursera/Youtube) are not respected as credentials, since they do not showcase this.
The difference I notice with AI is that the bell curve is nearly inverted. You have the good students, who use AI to support their learning. You have the students who let AI do their assignments, and then fail miserably on the exam. And there is hardly anyone left in the middle.
A lot of intro programming builds directly on previous lessons, much more so than, e.g., maths. If you missed how variables work (off sick, just didn't get it, whatever), you're still stuck when it comes to functions and anything else following and then you're going to fail - it was quite predictable. We studied other university courses and nothing came close to the pattern we were seeing, except "computing for chemistry" or something, which was basically the same sort of course just in a different department.
So we added explicit catch-up classes a few days after a topic was covered so if you missed it, you could get quite personal help on getting back up to speed. This really shifted the distribution to the right, then the people who failed were either those who just didn't care, or those under more extreme circumstances where this couldn't help (or those who just could not learn programming for love nor money but that was rare ime.)
I think you meant "bimodal", not "binomial". They mean roughly opposite things here. :)
In all seriousness, I don't see the value in this at all. Why would I want to know a statistically likely essay? Wouldn't I rather know what the student thinks?
For example, in the UK, it was shown that biasing course results towards exam marks caused woman to perform worse than men. But when results included assignments, women generally performed better.
This is obviously a generalisation but it is one of the reasons why so many courses now take assignments into account for their final grade.
However what you mention about different people being better in different circumstances reminds of what our maths courses typically did, it was called "plussage" IIRC. Basically, the scores were calculated, and you got the best score from a 40% exam/60% assignment weighting or a 60%/40% (or something, the exact values are lost to time.) So if you were bad at exams but had done the work through the semester, you got a boost. Or if you were bad at deadlines but had still studied, you weren't (too) penalised.
However, when some colleagues tried homework as 0% for introductory courses, most students omitted the homework, then failed the exams. Modern students seem to require explicit incentive to work, otherwise the usual: scrolling upon flat screen devices, hedonism, and so forth.
In this case, who has failed: the student, or the professor?
And to pass an exam students have to prepare for the exam. Homework will only help there if it is similar to the exam.
One time I had to evaluate a written exam where the professor had set up a trap. There was a question that looked like a standard question from homework, but if you used the standard-techniques from the course your calculations didn't work - it was a nasty special case. Most people that started with that question just burned 30 minutes without getting anywhere... a lot of students failed, but at least they learned something about life...
And Oral exams are different. Giving a quick well prepared answer and being able to solve difficult tasks over a few days are completely different skills. Students there prepare for the professor. There are transcripts of previous oral exams. And professors change over the years - the final tough question of an excellent student will a few years later become a starting question. People that didn't know that game and didn't have access to any transcripts were in serious trouble... None of the Homework would have helped in the oral exam.
And to pass an exam students have to prepare for the exam. Homework will only help there if it is similar to the exam."
That's not learning really. I can confidently say that because I was the one who unfortunately regressed to this during the uni, and the same story with my peers. One simply can't prepare to the multiple exams sufficiently in a few weeks time (or less). So the only path left is hysterical rote memorization of as much material as possible to squeeze in at a passing grade, and then immediately forget all of the materials in a few months time. Burst of "learning" twice a year for a short time doesn't translate into real learning.
And that's for some simple courses during first few years. Specialist courses later in the program sometimes are impossible to rush "learn". When I tried to pull this off for Probability Theory course, I've failed spectacularly to get even lowest passing mark at first try. And others failed the same way.
If good results are important, it's most important to know what happens in the exam - and adapt professionally. Learning is fun. I myself always did a lot of homework. But I wish I had been more professional - constant challenges are fun, but most of it is not very time-efficient.
- People need to learn how to write. The quality of student writing was one of the biggest criticisms of students when I was in university, and that was 30 years ago. Writing will only improve with practice and someone to evaluate it. Very few people will be able to learn how to write properly by reading about it, and even fewer people will even realize that you can learn how to write by reading the work of other people (which is important for learning about style in a particular field). For most students, even well meaning ones, no grade means no work done.
- A certain segment of the student population will find ways to cheat anyhow. All you have done is raised the bar so that, hopefully, fewer people will cheat. Quite frankly, I don't know how helpful that is if the "top" of the class moves on since the top of the class tends to be defined by their GPA.
- Test anxiety is a real thing. Different people go to school for different reasons, not all of which lead to high pressure careers. Do we really want to limit who can effectively access an education because of that?
There is no easy solution to this problem. Likely the best solution would be to remove traditional assignments and exams from the loop altogether and having students work directly with their instructors. Yet this has it's own set of problems (it assumes both parties are honest, it is difficult to ensure consistency in the delivery of curriculum, etc.).
But the point of the university is not only teach English grammar and math operations, but also to work in teams, manage yourself, etc. The social stuff. And I suspect a significant number of students benefit from it. And I also suspect that by doing this at scale, the whole society benefits on average.
Removing all control and only checking the knowledge during the exam would lead to a lot of students never catching up. It is likely that it will also lead to the top students being more and more lax and eventually also falling behind.
The whole idea hinges on the base motivation - why do we need primary/secondary etc. education at all? To produce a dozen elite self motivated geniuses per year per country? Then your proposal would work perfectly. Or maybe motivation is different?..
For example, in an English class with a lot of essay-writing assignments, the assignments could simply be worth 0% of the final mark. There would still be deadlines as usual, and they would be marked as usual, but the students would be free to do them or not as they pleased. The catch would be that the *proctored, for-credit* exams would demand that they write similar essays, which would then be graded based on the knowledge/skills the students would have been expected to gain if they'd done the assignments.
Advantages:
- No more issues with cheating.
- Students get to manage (or learn to manage) their own time and priorities, as is expected of adults, without being whipped as much with the cane of class grades.
- The advanced students who can already write clearly, concisely and convincingly (or whatever the objectives are of the writing exercises) don't have to waste time with unneeded assignments.
- If students skip the assignments, learn to write on their own time using ChatGPT and friends, and can demonstrate their skills in exam conditions, then it's a win-win.
This all requires that whoever is in charge of the class have clear and testable learning goals in mind -- which, alas, they all-too-often do not.