In any case, this doesn't answer the question of why more people don't (or historically didn't) paint the outside of their houses red.
In design courses I was always taught that red and yellow are psychologically associated with hunger/food and this is why most fast food branding uses them [1]. I haven't seen any actual science behind this, it's always presented as fact.
I have personally encountered the color black being linked to death/unluckiness in Asia, as a new franchise of a major eCommerce company insisted I make their website's background white, instead of black like every other country's.
[1] http://www.colorschemer.com/blog/2007/07/17/why-food-compani...
Funnily enough, in Asia white is also linked to death or morning. Thus the ban on white t-shirts in some parts of China this month.
There are psychological impacts of color schemes which make heavy use of it undesirable for dwellings (its also why it is frequently used in fast food restaurants, because its gets people out the door faster.)