I think you're conflating biological evolution with evolution as a whole. Technology and culture also evolve. Just differently. Evolution is a much wider aspect of existence than mammalian genetic evolution, or even sexual evolution. I absolutely can simplify my brain consciously, by choosing to remember useful, compact things and by choosing to forget useless, complex ones. And then pass that knowledge through our cultural transfer mechanisms.