The OS needs to handle downloading updates in the background while streaming or recording the game, running Spotify and Xbox live party voice chat, and the dashboard. It could probably make do with less but you can't change (e: increase) the memory allocation later.