The problem is that mathematical notation itself is insanely complex and very nuanced, so any attempt to replicate it digitally will also be insanely complex.

A better solution IMO is an alternate mathematical notation which can be simple and unambiguous not only for humans, but also computers. Something like apl - https://www.jsoftware.com/papers/tot.htm