It's called brutalism because brute is the French word for concrete. To many being made out of concrete would be a defining feature of brutalism, to others it's the exposed building materials without façade.