That's just making excuses for poor software architecture without clearly defined layers and stable, documented APIs between them. MS Windows has a hardware abstraction layer. There's no reason Android couldn't have the same, except that it wasn't a priority.

Some of this is (or was) a fundamental design limitation of the Linux kernel. But there are other kernels.