Well. Sure. But that's the point. That's why it's called identity theft. Someone has acquired the information about you needed to effectively pretend to be you.
For example, say I convince the police that you committed murder. As a result they arrest you and put you in jail. By your logic, you're not a victim in this scenario because if the police didn't get fooled into arresting you nothing would have happened.
I think almost any reasonable person would agree that you were a victim in the above scenario. Regardless whether a third party bears some level of responsibility or was used as an instrument in that victimization.
This low bar is set by the banks!
I'm not saying that innocent third parties that the banks and financial system harass are not victims, I'm saying that the central role of the bank in the crime makes it more reasonable to describe it as bank fraud.
The murder analogy sort of breaks down, the dead guy (which I see as analogous to the bank) can't do a whole lot to push the consequences of you murdering him onto me. A bank that opens a fraudulent account can (and in fact, this is the major source of the problems for those that are impersonated).