There used to be a one-floppy installer with the desktop on it, I'm sure you could get that to work in a VM.
Lots of screenshots:
https://www.operating-system.org/betriebssystem/_english/bs-...
Docs:
https://www.mikecramer.com/qnx/qnx_6.1_docs/sysadmin/intro.h...
Unfortunately I can't seem to locate any disk images, rumor has it there was a VMWare image floating around.
Unfortunately QNX 6.5 is pretty old and not too well-supported (QNX is fully POSIX-compliant so you can sometimes get things working on it without too much trouble however) but it's damn fantastic to play around with in a VM. It's actually so fun.
Grr.
In this model, your compositor, input pipeline and (at least the UI latency sensitive part of) your applications would have to be ported to the RTOS, which makes this pretty infeasible. But it works really well if you have a some hard-realtime control loop talking to a bunch of non-realtime network IO or UI code. Would be a fun way to build a wifi controlled quadcopter.
These days you probably want to use Xenomai, or possibly RTAI.
Thanks for the great writeup correcting me!