Or at the lower levels, consider human perception systems. We start to understand how early layers of vision work, even if we don't yet have a good grasp of how higher levels of visual cognitive system work.
This isn't true. Freud's enduring contribution to psychology isn't stuff like penis envy in women or interpretation of dreams, but that thing which you now likely consider a fact: recognition of the existence of the subconscious.
The impact of the subconscious, and the impact of life psychological history on later behaviour (and the fact that recognizing that impact of personal history can assist treatment) was not a recognized process before he promulgated it.
I think you're mixing up clinical psychology and experimental psychology. The aims for both will vary, and I tend to agree with you that presenting psychology as a hard science is ludicrous (but unfortunately the only way to get funding). You're also right about the political component of psychology (your homosexuality anecdote); psychology can be used as an instrument by the leaders of society for political, social, and economic gains and control. That doesn't mean it has no contribution to man's knowledge of the world.
Just because the newer approaches appear to reject older theories does not mean the older theories aren't useful. Newtonian mechanics explains phenomena quite well for everyday living. Relativity was a revolution in the field but there's a still a place for Newtonian physics (i.e. you don't have to erase the classical theory). The way knowledge evolves in these long-standing fields isn't as mechanical as I think you're claiming it to be. Science is much more complex than that.
So the smartest people aren't doing it and on top of that far fewer people in general go into it. I have no idea about this but maybe there's fewer grants for psychology and so fewer people are encouraged to go into research?
Doesn't every single generation of psychologists pretty much completely reject the findings of the previous generation? All of Freud's stuff is now considered total bullshit. All of the stuff psychologists said in the 50s about homosexuality being a mental illness is now considered bullshit.
In other fields of science, like chemistry or physics, this has never happened since the introduction of the scientific method. Scientists have been wrong lots of times, but never has the majority of the body of scientific knowledge been thrown out. Usually the changes are something small, e.g. "Einstein was wrong about hidden variable theory in some respect." Even the most drastic changes in scientific thought are usually just the narrowing down from a number of existing theories to a smaller number of theories. In most fields of science, we seem to converge on the correct result over time, with very small deviations.
Psychology doesn't seem to be converging at all. Am I wrong? If not, why is this?