News for hackers. Stuff that matters.
Re:Programmer's critique of missing structure of operating s... by bvrmn on Wednesday February 19, 2020 @10:38AM (#22366396)
> Implementing streaming files over record-based files is easier

What a performance-wise nightmare. Goodbye page cache and other zero copy optimizations.

Re:Programmer's critique of missing structure of operating s... by zaarn on Wednesday February 19, 2020 @11:22AM (#22366936)
Not really, the OS still has to abstract it onto the harddisk, this should be trivial to achieve without impacting page cache and zero copy optimizations if the on-disk metadata is seperated sufficiently. COW Filesystems already do it to a lesser degree and they're certainly fine.
Re:Programmer's critique of missing structure of operating s... by bvrmn on Wednesday February 19, 2020 @11:41AM (#22367167)
What to do with clients who want a stream of records? Separated meta + payload allows fast byte streams. Combined meta + payload allows fast record streams. Structured implementation can't provide performance for both cases. But byte-oriented can. And we see this approach in modern and fast OSes.
Re:Programmer's critique of missing structure of operating s... by zaarn on Wednesday February 19, 2020 @11:43AM (#22367197)
Allow clients to choose which they receive?
Re:Programmer's critique of missing structure of operating s... by bvrmn on Wednesday February 19, 2020 @11:56AM (#22367351)
May be I was unclear. If we introduce record abstraction for file ops then OS low-level implementation have to decide which way to store structured data. meta + payload or meta separated from payload. In latter case there is no way to provide fast record streams. Former case does not allow fast byte streams. Client decision to receive bytes or records doesn't magically zero copy reorder stored data.
Re:Programmer's critique of missing structure of operating s... by zaarn on Wednesday February 19, 2020 @11:59AM (#22367398)
Why would the later cause record streams to be slow? Snapshots in COW FS' aren't that terribly slow either, even if there is quite a few of them, which basically boils down to the same structure, really.