First, it’s probably illegal in the USA due to ADA unless you could show that it tested something physically related to the job. Example: a big company is required to make accommodation for a, say, qualified analyst who is blind, but can reject a blind candidate for a job that required driving.
But after 45+ years of hiring programmers, the world hasn’t yet figured out which factors are germaine and which are not.
The trouble is, they actually can't do that because then the pool would change, quickly.
But I think like you say, what they did do was create a filter that only very patient and technically qualified candidates could get through. Beyond passing the filter, their very standardized process did not derive any useful information about candidates. But I feel pretty certain if they made an offer to every candidate and not just those on the pass side of the filter line, they would have seen some differences.
The other parts of the interview might be doing something per se useful, I suppose.
I thought it was just the leetcode, but it's the behavioral questions and system design exercises, too.
Eh, I'm coming across as cynical. I'll be fine--I just wish we (as an industry) had a better system.
Until, I don't have a job I'm not grinding leetcode. I also dislike people who refer to themselves as ex-faang. I really don't care.
Being able to tell a great story might not be highly valued at most orgs, but I think it's part of Amazon's culture and something they desire in their skilled positions.
The person watching on the other end can evaluate how far over 100 you got, whether or not your form matches best practice, and assess how you were breathing in case... you know... they hire you and then there's a business need for you to do 500 jumping jacks in five minutes.
They might not even end up hiring anyone different than they otherwise would.