Honestly, I would rather live in a Brutalist house than a McMansion. At least it might be competent in both architecture and construction, if a bit eccentric.

Most of the examples I can find online of Brutalist homes are actual mansions, however, so it's hard to compare apples to apples.