https://fnoschese.wordpress.com/2011/03/17/khan-academy-and-...
The simplest description is this: Consider two videos. One is a clear lecture (eg Khan Academy style), while the other is a dialogue between a character who espouses the common misperception, and a teacher who illustrates their mistakes. After watching the videos, you have students evaluate how well they think they know the material, how they feel about the video, and then you test them on how well they learned the concept covered by the video.
The lecture video had the following results: - Highly rated video clarity - Increased confidence in knowledge - zero change in knowledge (tested)
That is to say, students liked the video and thought they learned something, but didn't actually learn anything.
The dialogue video, on the other hand, was almost the opposite: - video was considered confusing (not at all clear) - decreased confidence in knowledge - large positive change in knowledge (tested)
Students, it would seem, don't know enough to be able to evaluate what is good instruction. (cf Dunning & Kruger)
https://www.refsmmat.com/notebooks/pedagogy.html
The Peer Instruction section features a great deal of research in introductory physics courses, where well-implemented active learning methods can double or triple student learning of core concepts. (I also blogged about this research long ago: https://www.refsmmat.com/posts/2012-10-19-shutup.html)
Students in intro physics classes tend to memorize the formulas but don't have any conceptual understanding, and active learning seems to dramatically improve the conceptual understanding without harming the ability to solve typical calculate-the-force problems.
Happy to discuss or send PDFs if you're not able to obtain them. My email is in my profile.
The point of lectures were to lay the groundwork for the active learning component. Without that foundation, the students would have been forced to find other means to acquire background knowledge.
tl;dr:
> Without that foundation, the students would have been forced to find other means to acquire background knowledge.
You say that like it's a bad thing.
While those are fine modes for learning, lectures do have the benefit of being a social mode of learning. Even in the extreme case of a lecturer who is playing the role of a sage on the stage, students still have access to other students. In less extreme cases, students still have access to the lecturer and the lecturer has the opportunity to include different instructional strategies. In other words, the benefits and drawbacks of lectures largely depend upon the attitudes of the instructor and students.
The problem, up until the advent of MOOCs, was there was no incentive for higher education to improve. Prices go up every year, more instruction is dumped on post-docs and adjuncts instead of professors, but the number of people going to college continues to increase. Why improve your product if people keep buying it regardless?
And this idea of active learning is nothing new. Maria Montessori did extensive research on effective teaching methods more than a hundred years ago and moved more and more heavily to small projects and physical interaction as the most effective means of instruction.
http://www.infomontessori.com/sensorial/visual-sense-binomia...
I happen to like the binomial cube as an example, because it takes a confusing, "just memorize FOIL" type of concept and turns it into something you can directly interact with to develop a much clearer understanding.
And of course, there's things like this: https://xkcd.com/1356/
Or the explorable explanation that was on the front page the other day about game theory and trust: http://ncase.me/trust/
Or Brett Victor's classic Up and Down the Ladder of Abstraction: http://worrydream.com/LadderOfAbstraction/
The ability to interact with a model blows traditional educational methods out of the water as far as gaining serious understanding (imo), and I expect this type of instruction to only grow in importance as time goes on.
One nice thing about VR/AR for education, is that different media have different "it's natural" styles of use, and for XR, that's hands-on physical manipulation of models.
> 50% of students I knew (secretly) spent thousands of dollars on recorded medical lectures
While this may be indeed be true for the students you know, this is also a common practice, in general. The pay-to-play nature of board exam preparation has existed much longer than the active-learning trend. There's no way to know whether these students would have purchased additional materials in another educational system.
> thus did well on the tests (and MCATs) anyway.
You seem to be conflating a couple of things. The MCAT (the Medical College Admission Test) is taken before medical school. There, just as for later examinations there has been a proliferation of prep materials, for which students pay dearly. This is in no way related to curriculum change in medical schools.
Again, you are correct that students who pay more do better.
> "objective peer-reviewed studies" of this learning style won't show score/testing degradation -- because the students are so self-sufficient that they work around the failing format with supplemental lecture materials purchased online
I understand the sentiment, but if students do better after the adoption of this new system, aren't they learning better? Eventually, medical students move from Wikipedia to more authoritative sources like UpToDate or primary literature. If they, themselves, are motivated to expand their knowledge - and as a result do better on tests - this intervention would have been beneficial.
I think you're implying that the huge industry behind medical test preparation materials is new, but this is decidedly not the case.
> MCATs are taken before medical school
Sorry, that was just a brain malfunction on my part. I meant to write "USMLEs" (residency admission exam for match process). Corrected my comment to state that.
> "but if students do better after the adoption of this new system, aren't they learning better?"
They are not doing better under the system. They are doing the same, or marginally worse. But I believe the students are more stressed, and getting less value per student debt dollar, due to the "active learning" trend. They are also less prepared for the USMLE and less prepared for residency than they would otherwise be. But they are substituting personal effort for their loss of solid foundational instruction.
A really good study would give students half their topics in lecture style and half in active learning style, and measure time spent and topic on "supplemental" learning outside of class.
Err, no. It's quite clear that traditional lectures work poorly, even when they are well done and well liked. And that active learning, when well done, is unambiguously better. However, it's also clear that doing active learning well, takes a lot of instructor training, preparation, and practice. So deploying it is a known problem, with it's own research.
Though there's some work on doing hybrids, lectures with sort of a "sing along" question-response, with an effectiveness in between, but easier to train for and deploy (at least for big introductory classes).
Which isn't to say that I don't facepalm and think "we need to be doing so much better than this", even when watching active learning at MIT, with its years of instructor and institutional experience across several departments.
And even as VR/AR transforms education, something like active learning seems likely to remain a key component. After all, good ways to learn something include practice it, discuss it, and teach it.
Just reflect for a moment on this general statement. You are saying traditional lectures -- a format used for millennia in education of every professional and technical class of society across multiple continents -- "work poorly".
And, we are meant to believe that "active learning" -- a new teaching style that throws away the lecture entirely and replaces it with group participation from students -- is, on the average, better.
Now imagine if I said this... "deep reading of books written by leaders in their field/discipline, even when those books are well-liked, work poorly."
How credible a claim could someone then make that "active reading" -- a new teaching style where we eschew books altogether and instead write and read material generated by students themselves -- is, on the average, better? Especially if in the classrooms where my hypothetical "active reading" is deployed, the students secretly buy well-written books, read them, and pass the tests just as well?
Most disciplines have never needed lots of theoretical preparation before someone could be put to work, so lectures weren't even necessary. The master could just show the apprentice how his apprentice how he does something, and then let him practice for a few hours.
The more theoretical fields probably started with small groups of wealthy people, which allowed much more direct interaction with the teacher. And what I have read from ancient Greek philosophers almost always involves some kind of dialogue between teacher and students. I can't really imagine aristocrats quietly listening to a lecturer anyway.
The first lectures to a large audience in an amphitheater were probably public dissections, and even there the medical students had plenty of opportunity to do the cutting themselves, under the direction of the lecturer.
The current "traditional" style of non-interactive lectures is probably actually very recent; together with the emergence of mass-education.
Your "active reading" sounds very much like the descriptions I have read of writing circles in creative writing, where students read each other's work and discuss how to improve it. It seems to work fairly well for them. Of course everyone still reads other books, but that they can do alone, while "active reading" can only be done together.
What this means for active learning is that when classroom presence is used for interaction with other students and the teacher, while students who need lectures watch them on their own, this is no indication of failure, but the system working as intended. (Except having to pay for lecture videos. Those should be free.)
The whole point of being in the same room is the possibility of interaction. If the lecturer is just going to rattle off their script while flipping through the slides, I would rather watch that on video where I can set 2x speed until the hard part starts.
This is a very misleading summary. The most dominant format for millennia across continents etc. is apprenticeship and direct tutorial (sometimes called “coaching” or the like). Even today serious high-level professional training is done by such means.
Lecture is a low-quality substitute which people turn to when the number of students vastly outstrips the number of teachers, and the teachers can’t afford the time and attention to work directly with the students in small groups.
In universities, early introductory courses get stuck with lectures so that scholars can focus their direct instruction time on graduate students who are serious about becoming scholars themselves.
There should be some kind of structure, and I imagine, if there are exams, there is some kind of structure, for the students to be following. There should be required textbooks as well, so that resources are consistent.
And, of course, there needs to be unbiased feedback to improve the system.
Also, even lecture-based students spend thousands of dollars on outside material. And doing so isn't a "secret". At least $300-400 is spent by each medical student for the arguably "required" board prep materials, completely disconnected from how they learned in the first two years.
That said, I've personally experienced great teaching supplemented by great lectures, and I've not personally experienced great active learning.
I studied computer science and philosophy undergrad. I had great professors and not-so-great professors in each. The excellent ones had excellent lectures that I still think back on today, years later. Plus, as a typical programming auto-didact, I learn a ton from recorded lectures/talks on YouTube and similar channels. I wouldn't trade these resources for the world. I can remember a handful of classes that had more of a group/collaborative feel to them. I don't think I'd describe any of them, in retrospect, as "successful" classes.
I remember one, in particular -- an algorithms class -- where the professor had just done a long sabbatical in Japan and was trying to cargo cult the group/collaborative learning techniques he witnessed there in his algorithms class, yielding hilarious (and definitely not effective) results. That was the one class where I had to pull an all-nighter at the library, cramming from Sedgewick's "Algorithms" textbook (which wasn't assigned by the professor, but every student had passed around as the right way to learn this stuff) and the odd Wikipedia page. All this effort to pass the final exam -- because I felt like I had spent an entire semester witnessing an educational experiment, rather than learning anything.
I imagine many people are in the same boat as me in terms of their experience levels here. Lots of experience with successful lectures, very little experience with successful group learning environments. Certainly, lots of experience with good and bad teaching all-around, where "style" doesn't seem to be the critical issue.
I am afraid too many of these institution-wide shifts to "active learning" are being made on little more than well-intentioned hopeful faith.
Now, recorded lectures, on the other hand, are superior. Combined with the ability to directly contact the lecturer, it would be an infinitely more successful method of learning for me.
Perhaps the way forward is the way my medical school does it - 3 different pathways: lecture-based, problem-based, and self-study. Let each student choose the path best for them.
These days, we are much more mature about "best tool for the job" -- OO design for state/behavior binding APIs or data structures; FP for concurrency/parallel computation; simple imperative style for mission-critical code that needs to be read/reviewed by many, etc. (among other examples.)
I don't think it's controversial to think that in something as complex as human education, there may be multiple learning tools available to us. We should avail ourselves of each of them.
The recorded lecture, the live lecture, the class Q&A, the take-home assignment, the group study, the deep reading, the thoughtful essay, etc. Put it all on the table. Don't ban any one form out of some trend while declaring, "the lecture is dead!"
I also agree with you that it might also be the case that by allowing some amount of tailoring/personalization per student (a la Khan), we could probably get very good average results, since students can smooth over some of the rough patches where the more dominant teaching style is failing them individually. For example, I personally found it much easier to learn Linear Algebra by working through my problems in Matlab. I noticed other students did just fine with working out the math on pen-and-paper, but I needed the iterative and visual feedback to really grok what was going on. It feels "obvious" to me that different students learn differently -- and different topics demand different learning environments! Why are we trying to shoehorn every student and every topic into a single dominant style?
I go to a medical school that heavily emphasizes small group based learning. We have lectures, but they are optional and poorly attended. Most students only attend the small group sessions 3 times per week for the first two years of med school (largely because those sessions are required). At first, the small group sessions seemed helpful since there's more of a chance to have a discussion about difficult concepts and topics. After a while, however, you get the feeling that the small groups are just the blind leading the blind. Often these groups are led by fourth year medical students (such as myself) that are not nearly experienced enough to provide adequate guidance to first and second year medical students. Usually, the main takeaway students get from these sessions is that they should read First Aid, do their question bank, and watch Pathoma. All of which every med student knows to do anyway.
5 years after graduation, I feel like I am only starting to truly appreciate that comment. I started medical training 11 years ago, and half of the stuff I read in books during first year was probably already known to be wrong.
The lectures we received were biased and incomplete, but they provided a largely up-to-date picture and, more importantly, a story.
Medical Schools largely understand that everyone studies and learns differently and that's why they don't mandate you come to lectures. They're recorded for your own benefit as well. My professors would also provide several different learning methods throughout the preclinical courses to really hammer in those mainstay concepts regardless of how you learn. Be it quizzes, or team based learning, or straight lecture.
http://news.nationalgeographic.com/2016/07/body-donation-cad...
My wife went to a medical school that had recently adopted so-called "active learning" techniques. All the students secretly hated them, but wouldn't share this feedback with higher-ups (academic administrators) because med students, as a group, are generally rule-following, adaptable students.
The "non-lecture" format was frequently derided by students, in private settings, as "Dr. Wikipedia". That is, they were learning medicine by using Google and visiting Wikipedia pages. Because they had to collaborate on their own learning materials, even though they had no background in medicine.
About 50% of students I knew (secretly) spent thousands of dollars on recorded medical lectures to supplement the completely ineffective class "group activities", and thus did well on the tests (and USMLEs) anyway. They never reported this to professors or administrators. Again, they were "working around" the broken "active learning" system. One of the hilarious side effects of this: the supposedly "objective peer-reviewed studies" of this learning style won't show score/testing degradation -- because the students are so self-sufficient that they work around the failing format with supplemental lecture materials purchased online! Thus, they still achieve the grades they hope, and the administrators think the system is "working"!
There was, however, a very small subset of students who preferred the "active learning" format. Most of the time, these were students who came into med school with a stronger science background than others (e.g. had basically started studying medicine before they got there). One reason they particularly enjoyed the format: they could skip class with little effect on their grades.