And how much you can afford. My partner's scientific research group recently upgraded their shared server used for analysis ... to one with 32 GB of RAM and 8 TB of storage. I think they could have done better, personally, but it's telling how thin budgets are stretched in a lot of real world cases.
Something like this [1] gets you to 4TB of ram. Dual socket Zen2 Epyc gets you 8 TB ram. A lot of stuff fits in 8 TB of ram.
[1] https://www.supermicro.com/en/Aplus/system/1U/1113/AS-1113S-...
The trouble is that there are limits to how much memory you can fit on a motherboard.