Re:Nvidia DGX GH200: The First 100 Terabyte GPU Memory System
by samstave on Wednesday May 31, 2023 @11:43AM
(#36139650)
A write queue with a dupe-back-end to say a blob on S3 or whatever would be interesting for mirrors of outcomes could be stored.
The biggest issue it seems is bandwidth and humans' patience for a response...
But upon further thought, a lot of things such a system would need are actually rather inefficient to implement in software (ie. rollbackable RAM), yet quite cheap in hardware (for example rollbackable RAM can be implemented with regular RAM plus either a buffer of 'overwritten data' or a write queue)