I don't know about GPU contexts: is there no way to hand them off? Reliable hot reload is always painful no matter how you do it. I don't know the situation with gpu contexts but if your long running program needs hot reloads and has a gui, maybe you want to split the gui itself into a separate process, or alternatively maybe do that with the component requiring reload.