Test-retest reliability / concurrent reliability (not sure which applies):
Doesn't look great. Grades can vary dramatically between classes, even if those classes are closely related.
Predictive validity:
Not sure. I'm not sure what, if anything, GPA is meant to predict, and I've read varying things about how well it predicts success in one's career.
Face validity / construct validity:
Abysmal. What are grades supposed to measure, anyway? Work ethic? Motivation? Willingness to obey authority? Intelligence? Demonstrated mastery of the material? I have no idea.
Whatever they're meant to measure, they measure a lot of things no one would want them to, like the student's race and sex, whether or not they're working while in school, when the class starts, etc.
Some systems attempt this, at the level of individual courses, and what seems to happen is the educator focuses ever more on bureaucracy. It means that they can't be free to adjust the course to the class & the time, but must pre-commit to some plan which is approved by someone else, and the exam will be submitted many months ahead of time to get checked by other people, who do this in addition to their own teaching. All supervised by ever more administrators, incentives to make themselves unavoidable.
Some things like bar exams are external and standardised. (And GRE etc.) But trying to run every course this way seems a terrible idea.
Ideally I think this should be done at a high level -- i.e. separating the institutions that do the teaching from those that do the testing and award the credentials.
More practically in the short term, it would be great if teaching and grading were separated and allocated to different staff members. (Preferably with a proper firewall between them, to guard against politics and favour-trading.) There are just too many conflicts of interest and emotional pressures involved. This separation may also increase the likelihood that grading would be taken seriously, with markers given enough time and incentive to do the job properly.
Do you still think that would be the best approach?
I’d also like surveillance in place with the express intent of catching and correcting bullying. But that’d encounter political push back. Bullying, though, should be taken as seriously as bringing a gun to school and a kill list. Lots of counseling, parental oversight, etc
And if all of this is too much then we scrap public schooling and offer online teaching with plenty of library study spaces.
It should be possible to flag a bad grade, doesn’t mean we need to institute a surveillance system to achieve this. The same goes for bad actors playing teacher.
The ACLU even has an app that can start recording by voice command. You should use it any time you are in a scenario with disproportionate inbalance of power (like when a police officer pulls you over).
I have, at times, walked in to situations with my phone's voice recorder running. I have, at times, photographed and filmed the police.
What does the right to record yourself in public have to do with institutionalised panopticon style surveillance?
I wasn't necessarily arguing for institutionalized/state surveillance, but that ideally, by my own experiences, I'd wish I'd have had every moment of my interactions in public available. It's simply too easy for people in power to abuse others.
They had me convinced I deserved the abuse or that it wasn’t abuse. They were “just telling me to expect to live my life alone and that no one would ever love me” out of the goodness of their hearts.
Why seek help with something that’s “not even a thing”?
That’s why third parties need to oversee student interactions.
Is there a good way to abstract testing away from educators so they can focus on teaching? Isn't that the way it should be done?
In high school I found video games and chess, which captivated my competitive drive. Shouldn't education have such objective competitions where possible? I think that would eliminate such biases, captivate more minds, and propel human progress. No?