You might want to take a look at forthstation which runs on an esp32 and outputs to vga. It's relatively simple to switch to SPI lcds as the underlying esp32forth compiles under the arduino ide

https://esp32forth.forth2020.org/projects-10

There is some limited graphics support. The underlying system (ilo) has a branch for x11 providing a limited framebuffer and pointing device support, and the native x86 system optionally supports a low resolution display (but no mouse yet). My son & I are working on expanding the graphics functionality, though we aren't expecting to have this work finished until later this year.