The reason why many find/found it ugly is that it's cheap. There's a long history of expensive things defining whats beautiful in architecture.

The typical red of Swedish houses is imitating brick houses: https://en.wikipedia.org/wiki/Falu_red

Timber framing houses were often directly built with a stone facade. Only nowadays we have learned to love timber framing houses.