Having tried a number of different ways to do admissions, I can assure you doing interviews is possibly the worst.
As far as ISAs go, it all comes out in the wash. If you create a pool of ISAs and students don't get hired you may have more ISAs but the average ISA is worth less, so the only thing that matters is whether each individual student gets hired. There's no financial wizardry that can let you sell $1 for $2 in the long-run.
For the interview thing, that's just what you were doing at the time. At the rate you were iterating, I'm sure that there's a better process now.
Yeah, some do a remarkably good job of cheating and would get into hiring stats for sure, but I think we've almost entirely cut that out now.
School mentality (and I might add: grifter mentality as well)
However, I've seen students use Stack Overflow and other resources as a source of "program stamps":
- They enter their problem in an Internet search engine.
- Click on the first result with code in it.
- "Stamp it" on their own code: I.e., copy/paste it.
- Using editor/compiler, find any issues by trial and error and fix them so the editor/compiler doesn't complain anymore.
They might try a simple example or two to see if it works. And that's it.
There's not much reflection on their final solution, or on the bits they copy/paste. They don't seem to understand their solution, nor care about that or their problem solving process. They put in effort, they expect a passing grade.
I totally saw people who had never coded before succeed, I'm not sure I could pick out in an interview who would do well and who wouldn't. It's a marathon not a sprint.
For the selectivity thing... I'm really not sure. The selling ISAs thing was a bit weird when I learned about. I honestly kinda wonder about the actuarial calcs of it all.