Windows remote desktop works fine on a VPN, unless network speed is low or the VPN itself is flaky. Of course it might be possible to avoid it entirely, with few internal servers accessed from the VPN through SSH and other reasonable protocols and few cloud services accessed through specific outbound firewall exceptions. Ideally, users on the VPN should access what users on the actual office LAN can access, in the same way.