News for hackers. Stuff that matters.
Re:Integrating NVMe Disks in HopsFS (HDFS) by SirOibaf on Tuesday October 16, 2018 @07:35AM (#18228449)
"HDFS and S3 are designed around large blocks (optimized to overcome slow random I/O on disks), while new NVMe hardware supports fast random disk I/O (and potentially small blocks sizes). "

Interesting solution presented here - keep the block size constant, but put the small files on NVMe disks.

Re:Integrating NVMe Disks in HopsFS (HDFS) by jamesblonde on Tuesday October 16, 2018 @10:41AM (#18229731)
Disclaimer, one of the authors here. You can see a video with discussion of the NVMe support in HopsFS in this Spark Summit talk:

https://www.youtube.com/watch?v=tx6HyoUYGL0

Re:Integrating NVMe Disks in HopsFS (HDFS) by senorcarbone on Tuesday October 16, 2018 @07:54AM (#18228559)
super cool. The world needs more success stories for NVM