Examples of what exactly you're claiming is precedent for this would be helpful.
Not sure where the 1Gb number comes from? A standard laptop now is ~16Gb of RAM, so 1000x (and 1Gb -> 16Tb would be 16000x not 1600x). We went from Kb to Mb and then Mb to Gb of memory roughly every ten years from ~1990 -> ~2010. Each of those jumps is 1000x
Talking this over with claude, though, it pointed out that the need in dealing with LLMs is bandwidth and read-only storage, since the weights aren't dynamic. So we're not necessarily looking at 1Tb of RAM, we could be looking at 256Gb of faster RAM, and multi-TB of (much cheaper) flash storage, with extensive caching built in at OS level. This is all technically do-able with current tech, so it'll be interesting to see if it happens.
I had a friend working in optical computing back in the late 80's that would wax lyrical about how optical computing was vastly superior to silicon back then. But it never took over because silicon worked well enough.
If we've hit the limits of silicon then there are other options. We would need to reinvent huge chunks of our tech stack, and that is incredibly expensive, but if the demand is there, we'll do it. The demand has never been there.