I wasn't suggesting there would be any disintegration. Just that off substrate memory will be reintroduced in-addition to HBM.
If you need a point of reference take a look at L2 cache. It was originally chips on the motherboard, then with the PII it was put on a Processor Card, then with the PIII it was eventually integrated into the Die.
The exact same thing happened with L3 cache.
The biggest problem after this is how much the GPU and CPU have to fight over main system memory, which really brings us to the end game of GPUs altogether. Sooner or later there won't be room enough for both in the picture, your single heterogeneous core or MCM will have both a CPU and GPU on it (and probably a half a dozen or more application-specific accelerators).