Update: other people have already scooped me:

https://medium.com/@yaroslavvb/tensorflow-meets-pytorch-with...

I've seen similar performance regressions on my own tasks and I don't have much to add beyond what's in that blog post.