There might be an hen-egg problem if the apps end up requiring a 128Gb AI accelerator card. You only get the card if there are apps to run, and you only develop the apps if the cards are wide-spread. With so much RAM, the cards will not be let's-through-them-into-a-cheap-build cheap.

I think there have to be a couple of killer apps that run "OK" with CPU or GPU, but would run tremendously better with such a card.