Really, I have been using Django for a while now. Its rarely the Django code that is the bottleneck, usually it needs some DB tuning.

(If you don't know the ORM well, its easy to let it generate a LOT of queries, have you added django-debug-toolbar to your project to see what it is generating?)