> My understanding is that there are not very strong theoretical underpinnings to most of the machine learning techniques in use today.

I wonder how come this is the case from looking at ArXiv, it seems there are plenty of low-hanging fruit relating to the Foundations of Machine Learning.