In practice we like things customized and only want to see our own savegames available on the list so this is a real issue that could break this especially if large number of strangers were to use it.
Another issue is waste - what if you want to play some game but it was installed on another console that is currently playing something completely different? Installing all games on all consoles seems crazy. Maybe have a large NAS with multiple games preinstalled? If we could add another type of game licensing which would allow for playing the same game on 5 different hardware consoles simultaneously that would be perfect.
Resources would be used to their maximum potential.
If you can swap storage, you can build around NAS connected storage emulators.
Otherwise, yeah, big storage and guessing about what should go where. Like Netflix CDN nodes, but with more black boxes.
It would certainly work better with manufacturer involvement, but you could use HDMI capture to source the video, and USB to provide the inputs, so the console doesn't know any better. There's some licensing rigamorole and content management as well. You could probably do a forced log out between users and rely on cloud saves, but that's kind of ugh... Would work better if you can trust the people you share the console(s) with.