That’s not easily possible – most ARM SoCs have no device enumeration, so you need to hardcode the memory addresses and physical ports of everything. These are different for every single chip.

EDIT: yes, some problems are now solved with Device Tree, but from my experience building Android ROMs, that doesn't solve half of the problems (as many SoCs have special custom hardware, too)

This is what DeviceTree solves. Not using DeviceTree now for SoC drivers is just pure laziness.

https://elinux.org/Device_Tree_Reference

Well, Device Tree solves some of the issues, but sadly not all of them.

A more stable ABI would certainly help a lot.

Isn't that what devie-tree and those dts/dtb/dto files starting to appear under the arch/arm/ tree in the kernel source are meant to address?