I have chosen Python for a similar large, complex, evolving application - in constant use whilst under development. The key is the speed with which I can write working, tested code. With an earlier (different) project using Java, I found the APIs and debugging being a huge drag on productivity.
Surprisingly I have found performance mostly acceptable. A small number of bottlenecks were addressed by rewriting specific modules as services in C and calling them.
As it is said: "Premature optimisation is the root of all cumbersome system designs". Get the data structures right first, then implement clean algorithms. Only when you can prove that there is a bottleneck and you can't speed it up sufficiently by throwing more hardware at it, only then do you rewrite as little as possible in C/C++.
Depending on what you're doing, Python may very well be faster than Java. I've done a lot of work with NumPy and found it to be both faster and safer than third rate roll your own numeric libraries that so Java programmers like to write. I've also had good success with Pyrex/Cython.
Assuming that run time performance won't be the determinative factor, your decision will probably come down to libraries and aesthetics more than anything else. I'd go with Python since I think it would allow you to iterate faster, but that's a very subjective decision.