Sure, this is technically correct, but somewhere there's a line of practicality. Running off a CPU (especially with swap) will be past that line.

Otherwise, you don't even need a computer. Pen and paper is plenty.

For all practical purposes, VRAM is a limiting factor.