You mean with all that paid vacation time they don't have, after using all 5-10 days of it (if there's any at all) to stay home with sick kids, or holding it in reserve to do same later in the year? Hell, that's a problem for most families period, poor or not. Vacation time is very scarce for most people and will continue to be until some significant minimum is required by law.
I’m not suggesting that anyone struggling to survive should prioritize travel over eating.
But I know plenty of people who grew up in dirt poor families who managed to take occasional long road trips in their childhood. And I know people who grew up in extremely wealthy families who barely ever left their hometown.
My point was just that means aren’t everything; attitude is also important.
The bigger impediment is profound lack of interest/curiosity about other places. Take George W. Bush as an example; he certainly didn’t lack for resources. http://www.consortiumnews.com/2000/102900a.html