Yes, you need bank collaboration and they don't want to share the data. Right now the only way to get it is web scraping, basically.

You could create a company that stores all your credentials for you, and they perform an OAuth layer, but then you have to trust them :)