News for hackers. Stuff that matters.
Re:What's So Bad About Posix I/O? by Derbasti on Tuesday September 12, 2017 @01:44AM (#15225071)
It seems like the OP really wants to use a database instead of a file system.
Re:What's So Bad About Posix I/O? by davidmr on Tuesday September 12, 2017 @09:16AM (#15226990)
I don't think so; HPC is a different beast There are very few if any organizations on earth that have a database that can write a sustained 1TByte/second+ from as few as 300-400 node to 100s of PB of stateful media for years on end.

Ken Batcher (maybe of OSU?) wrote a quote that the rest of us have been using for years: "Supercomputers are a tool for converting a CPU-bound problem into a HPC-bound problem."

The filesystems start to look more like databases over time, but it's not like they can throw down a nice Cassandra cluster and have it pick up the slack. I'm not saying it will never happen, but I don't think it's am option at the moment.

Re:What's So Bad About Posix I/O? by davidmr on Tuesday September 12, 2017 @11:22AM (#15228008)
Rather "into an I/O-bound problem". Apologies for ruining Ken's great joke.
Re:What's So Bad About Posix I/O? by emmelaich on Tuesday September 12, 2017 @06:48AM (#15226236)
Exactly. Layer a system on top of the usual I/O and you get the ratio of performance / statefulness you want.
Re:What's So Bad About Posix I/O? by davidmr on Tuesday September 12, 2017 @09:23AM (#15227040)
They do, more or less. It's called MPI-IO, but it's still tough.