Unrealized gains can simply evaporate. If a crap company has a 1 B valuation and it fails, that money is gone. The value in stockholders portfolio just goes down, not to anywhere in particular.