"In principle" is not only (1) hard in practice but also even in principle it is (2) limited by the capacity of the NN. It's (2) which gives me some reassurance.