It's interesting to note that your architectural example and Apple's devices are similar - the iPhone, to outward appearances, is quite simple to use. The innards however, are probably just as complex as any other modern operating system.
Computer chips are getting more and more complex as well, now with more levels of caching and inter-core communication.
I think we have a long way to go before we get simpler computers, but that does cause us to wonder if we will get to the point that they are just too complex.
Still, it's a lot simpler than a desktop computer - fewer parts, no moving ones... Splines' idea makes a lot of sense.
Simplicity on consumption (user) side can require massive scale complexity on the production side.
iPhone is grandma-level simplicity to use, but hard to replicate by competitors (despite massive investment by Nokia, Microsoft, RIM, etc, they have not been able to replicate the iPhone user experience, an experience which goes beyond the device to the ecosystem of AppStore, iTunes, etc)
Another example is Google search, which from the user perspective is one simple text-entry box plus one graphic and 12 words of text on the page. But on the other end of the wire is a server farm of a million machines and rocket-science algorithms, software infrastructure and operational processes.
A long way to simplicity: from Gothic cathedrals to Woolworth building to WTC