I thought the same thing when I first used hoodmaps, but the ability to add labels does a lot to make this less of an issue. You can just label a neighborhood as "Rich people and tourists" or "Tourists and office workers".