> I think it's actually going to be non-trivial to really make these tools both useful, smart, and unexploitable

I mean, you could say that about human teachers too. I don't think they need to be perfect to be useful. In the end, as Peter Thiel opined in his book, the future is humans and robots working together on solving bigger and bigger problems. A teacher working with AIs that tutor kids and then managing that relationship and the relationship with the parents, etc. while also being the adult role model that kids will always need will remain.