It's not bananas. What's bananas is the idea of getting all your raw materials from mines on the Earth, launching those to space factories, then sending the finished products back to Earth.

Obviously, the goal is to do the mining in space (moon, asteroids, etc.), and then use those raw materials in space factories.