Depending on how old you are, I might suggest that you were simply not aware of the details of your grandparents' lives at that time. And it just sounds like you have surrounded yourself with assholes in adulthood.