Isn't this what SDL (https://www.libsdl.org/) is for? Some cross-platform (and pretty light) hardware abstraction where you can have a canvas, do 3D, audio, whatever...