Edit: Fair enough, it seems games are doing this already, so maybe this argument isn't as valid as it used to be.
It should be noted that most AAA games install themselves to disk anyways to help alleviate loading times (especially in the PS4's case, as Blu-Ray is sloooow)
500 GB really isn't enough for a heavy gamer.
Although in good news the SSD disk storage sizes are only going up and the price is coming down, so by the next console generation it should be practical to put in a 1TB SSD into a cheap console.
The reason Sony upgrades media on its consoles is that Sony is a holding that also holds companies developing the said media and companies distributing movies/music on the same media. It's a cross-promotion.
The problem is it's a cost center. And downloading will always be more convenient. Connections are easily fast enough to transfer the static data.
This insane upgrade cycle will disappear. Steam Machines will hopefully increase competition in consoles market and will push MS and Sony to upgrade their hardware more frequently.
Previously, each console generation came with newer cartridges, then with newer disc formats (CD, then DVD, then HD-DVD / Blu Ray). But this generation just stuck with Blu Ray. That signaled to me that this may very well be the last generation to even support physical media.
If this console generation lasts the typical ~7 years or so... do we expect people to still be using any physical media in the early 2020s?