I don't understand how your comment relates to mine. isn't it more or less what I said? you can use the frameworks and copy the examples like using a jpeg compressor for compressing what ever you want. But without the maths it is very unlikely you will go further (for example: not even going from a single label classifier to a multilabel).

About fast.ai, I would want to know those basic principles about deep learning and neural networks. I don't see them so basic unless you have a good background in algebra, optimization, statistics and the scientific method.