One of the problems is that the blobs are preoptimized and stripped. You can see some of the crazy hoops people are jumping through to make AOSP work here, https://github.com/anestisb/android-prepare-vendor

What's obvious is that google isn't building AOSP themselves at all anymore and it's suffering from neglect.