Reportedly, disabling xcompmgr on the Pi helps quite a bit, though then you can't have translucent windows.

This article was helpful for the Rpi4 as well: https://lemariva.com/blog/rss/raspberry-pi-4-video-accelerat...