From that point of view, the interesting thing would then be why this particular abstraction layer works well which is what linear algebra answers.

This is in some sense the process all math students go through. The formulas for computing determinant and multiplying matrices look really complicated and it feels like a mystery as to why it works at all but then linear algebra explains all of that slowly.