Re:How to Know When a Child’s Flu Turns Serious
by dredmorbius on Friday February 09, 2018 @12:09AM
(#16338032)
It is very difficult to make such assessments. I don't think it's impossible, though the time to make an accurate assessment may take a while.
Solving a problem may be a useful guide. Find someone who can complete some specific task reasonably well, and even if you don't know how to do that task yourself, you may be able to make an assessment amongst various practitioners. This is easier to accomplish for simple tasks than hard ones (say: running a 100m sprint, or deadlifting 250 kg), but is the principle at the heart of, say, Jakob Nielsen's usability testing.
The problem is that there are domains in which tasks are complex, the time to determine successful conclusion is long, etc., etc. In this case, you may need to farm out the evaluation process, or look to evaluate institutions rather than individuals (say, in education, or medicine -- and there are reasons that the collective evaluation approach has validity for each, though also for adjusting for student population / case mix). The general problem of audits or programme assessment exhibits this.
My point isn't that assessments are easy, simple, straightforward, or not prone to their own issues. Only that there does exist a possibility in many cases for making valid assessments of service competence without specific competence in the service being assessed.
Solving a problem may be a useful guide. Find someone who can complete some specific task reasonably well, and even if you don't know how to do that task yourself, you may be able to make an assessment amongst various practitioners. This is easier to accomplish for simple tasks than hard ones (say: running a 100m sprint, or deadlifting 250 kg), but is the principle at the heart of, say, Jakob Nielsen's usability testing.
The problem is that there are domains in which tasks are complex, the time to determine successful conclusion is long, etc., etc. In this case, you may need to farm out the evaluation process, or look to evaluate institutions rather than individuals (say, in education, or medicine -- and there are reasons that the collective evaluation approach has validity for each, though also for adjusting for student population / case mix). The general problem of audits or programme assessment exhibits this.
My point isn't that assessments are easy, simple, straightforward, or not prone to their own issues. Only that there does exist a possibility in many cases for making valid assessments of service competence without specific competence in the service being assessed.