This was a huge pain for me in the past to the point that I started maintaining a boilerplate to avoid it [0]. But I've heard so many good things about dokku that I think I'll give them a try soon.

0 - https://github.com/dopeboy/django-react-docker-heroku