Screencasting should (with capital S) work on Wayland, but Wayland is much stricter about which processes are allowed to grab the framebuffer. At least for Sway (which is the Wayland compositor that I'm using) framebuffer access needs to be granted explicitly in the config, and only swaygrab (their own screenshot utility) is permitted by default.