If such states are preserved while the process that used them is still running then there is nothing to do: They will still be available to the updated program.
I was thinking about memory mapped resources, like memory mapped io. and resource references.
maybe you are right, there might be no problem. I need to read the paper to understand better.
lots of the servers are now using gpus for deep learning, may be adding gpu support to the framework is a good feature.