I have absolutely no idea, but I guess the bus to the processor and other periphery could indeed be a weak point because of EM-interference. We have absolutely crazy data rates here and therefore very high frequency signals so proximity between components might indeed matter.

That said, manufacturers have huge ambition to not allow for modular design.