When proving a new theorem the first prove is usually ugly. Only later they get ever more nicer and simpler. Since the fame of mathematicians rests mostly on new stuff they discover, there's a saying that `mathematicians get famous on the ugly proofs.'
Science: Everything should be made as simple as possible, but no simpler. - Einstein. (actually an abbreviated version of a longer quote - go figure)
Writing: Brevity is the soul of wit. - Shakespeare
Mathematics: Consider Euclid's proof of the infinitude of primes.
Architecture: Consider Frank Lloyd Wright's work over his whole career going from relative complexity (prairie houses) to relative simplicity (Guggenheim Museum). Or the work of one of my favorite architects, I. M. Pei.
Comments on web pages: ... I think you get the idea ...