Some people who retire die of it. Being told by society that you are no longer useful can kill. Obviously, that's not true of most people, but it does happen.

However, I do think the main reason it happens is also because it is accompanied by the ambient message that those who don't work are worthless, drains on society. If not working was more accepted, the death rate of retirement would likely be much lower.