That matters I would think. A concern for a powerful person is whether knowledge of an affair could give someone else leverage. If you are keeping up appearances then that signals appearance (and secrets) have value.