My evaluations went up a full point when I switched from writing my own open note/open book exam to using the department's standard "memorize all the things and do mechanical transformations" exam. Students complained a lot less also.
The result was that, after being challenged by difficult problems that require your complete focus, you are given some feedback on what you got wrong, at which point you go back to the book to work out what the real answer is. That revision step is key; the promise of some recovery points is mostly just motivation to take it seriously
I felt like those exams were huge learning experiences. The caveats are: it is more work for the professor; this was an upper division course, so students were serious and the class size was small; the best problems are hard and open ended.
Eventually it stops working.
I've had this especially happen with finals, like my Differential Equations final where I managed to get all the concepts of the entire semester onto a single page when studying. I had a lightbulb moment where I realized the important parts of the class were really simple, it's just all the twists and challenges about application made it seem more complicated.
Similarly I got mad at a grad teacher recently when he would not make our last lecture a review because according to him we shouldn't need "hand-holding." It ticked me off because a day to summarize what we've learned over several months seems like a smart idea to me. I guess I feel like tests can be similar, a way to filter out things that are taught that are good to learn, but not as important as other things. Kind of like when a teacher says, "If you leave this class and only remember a single thing I want it to be this."
On the other hand I see tests not working for some people. I have a close friend who has memory problems. She is so frustrated by college because due to her memory her application of the classes is completely different to how she is tested.
> Similarly I got mad at a grad teacher recently when he would not make our last lecture a review
Huh. A graduate course that ended with a review would feel really weird to me. I've never seen one or heard of one, and when taking a course never asked for a review, or saw a classmate ask for a review. (My direct experience is with graduate courses in mathematics at three universities on in Mexico, one in Canada and one in the US.)Edit: I just realized I'm not sure if the phrase "grad teacher" means a teacher of a graduate course, if not, disregard my comment.
The thing is that any speaker will tell you that if you want to teach someone something you should tell it to them three times - intro, actual discussion, and conclusion, so I view a last day study session as the conclusion part, making it a useful teaching tool. I totally understand that graduate students should be able to learn on their own and not need something like that, but I still think teachers should keep an open mind and try to teach their students as well as they can.
However our teacher told us several times, in kind of an arrogant manner, he wouldn't have the review because otherwise he would be "holding our hands." He didn't have the attitude that it's a tool, he didn't ignore it, instead he looked down on it like if you want a review then you're stupid. This guy constantly used us being grad students as an excuse not to teach us, he would expect us to know entire classes that were never required, never taught, and not prerequisites, simply because we were grad students. We actually had a project worth half the class that centered on a major networking project when the entire class had no networking experience. The whole class was miserable, we learned nearly nothing, and then he curves tons so we pass and he doesn't look so bad. I just hate the attitude that a teacher's job isn't to teach, but instead to read the book to the class. I encountered that with all my required classes in grad school while the electives were amazing with teachers who were extremely challenging but at the same time actually taught us enough to deal with the challenges.
Also, I don't think most of the courses can be summarized in a review lecture.
For example, if you were to have a open internet test in 2003, people who knew about wikipedia would have a significant advantage vs people who didn't. Or if the student is poor, he or she might not have access to fancy electronics or even laptops, which would make the open internet test difficult. Even if it was a open-book test, if the student were substantially poor to a point where he/she was sharing a book with a friend? And there is also an element of luck with it comes to open-notes tests. If the teacher only allow a single page of notes, what are the chances that the question might be on a subject that you omitted to put on your notes?
I've only listed tech-savvy, income, and luck as a potential way to make the test unfair, but I'm sure there are plenty more if you include any other element that is not the study material itself other than memory. I agree that in real life we don't have to memorize everything (matter of fact I'm all for critical thinking than memorization in schools), but there are certainly some benefit to the traditional test taking methods.
Normally if professors let you bring all your notes, they increase the complexity of the tasks and maybe even cut the time. So unless you wrote yourself a good summary or index to your notes, you will spent too much time looking through your stuff and won't be able to complete the test.
If you however wrote a good summary, chances are that you wont actually need it, since thats pretty much the best way to learn. But still the exam is harder than it would have been without books, so you are off worse.
So... they're the best way to learn, but you're worse off for getting them? Think about this argument a little more critically---I think what you're trying to say is that such exams are harder (which is true), but what is the purpose of the exam, and of the course itself? Surely an exam structure that is more effective at causing you to learn the material is better for you, not worse, not despite but because of the fact that it makes you synthesise a better understanding of the material.
But for general education history courses, the notion of "why" is just as much memorization as a list of dates. What if you disagree about the "why" that the teacher/textbook claimed? You'll lose points.
Besides, for all the history courses I've taken (just gen ed ones), tests weren't a big part. There were usually short quizzes on sections of the text book, which were testing for reading comprehension more than memorization. Essays and research papers were most of the grade.
You gave history as an example. I must ask then: what is the point of a history education? If you just like history and want to learn more about it, you'll try to learn the "real" stuff (beyond memorization) on your own. If you want to be a history teacher (especially for grade school), sure, you can probably consider the dumb memorization useful. If you actually want to work in the field (i.e. do research), the memorization won't be useful.
Some of us do exactly that. Many of the exams I sat in grad school (Brown) were that way, and nearly all of the exams I have set are open-book, open-notes, open-internet, and take-home. I've always felt that's a better reflection of what I actually want to be testing anyway.
I'm not the only professor that does this, but the cost is that exams take a lot longer to grade, generally. So it's impractical at scale.