And how do you ensure that it isn't really just a proxy for being poor? Since hunger, lack of a long-term home, parents who need to work multiple jobs to support a family, etc. are things which make it difficult even for smart and motivated students to learn.
Of course there are some smart and motivated students who can learn from books and online resources. But is that all of the remaining 60%? Or is it 5%
Bear in mind that Khan Academy disagrees with your assessment that it can be a general purpose replacement for teaching. Quoting https://en.wikipedia.org/wiki/Khan_Academy#Criticism : "Khan Academy positions itself as a supplement to in-class learning, with the ability to improve the effectiveness of teachers by freeing them from traditional lectures and giving them more time to tend to individual students' needs", so KhanAcademy" (emphasis mine).
On the other hand there is this line of thinking that sounds plausible, that we have the idea of instruction and homework backward in our school system. Kids should watch videos by great instructors as homework, and should do the exercises (what would normally be the homework) in the classroom. With the role of the teacher in this scenario to assist students where they have difficulty. This way the teachers aren’t spending 80% of their time doing the repetitive stuff that’s the same for every student but can instead focus more time on the problem areas students are having.