It might be easier for an engineer to fix a bug by changing some lines of text than readjust a neural network, for the time being at least.

As pointed out, there are already formal languages that allow formal verification like B [0] notably for like-critical systems.

[0] https://en.wikipedia.org/wiki/B-Method