The problem for most countries is that it can be decades between hosting two Olympics, meaning that facilities are either worn out not fulfilling the current Olympic technical requirements.

Also; very few countries has a need for facilities with the capacity the Olympics require, so this would be a huge burden for most of them.