News for hackers. Stuff that matters.
Re:File consistency (2015) by falcolas on Friday March 30, 2018 @09:26AM (#16715838)
> Kafka basically gives up on trusting the OS to store files safely

They're not alone. There are configs that you can pass to MySQL to have it manage files on a particular disk partition directly via drivers. It's a crazy level of optimization, but the OS does so much to make things fast that they aren't necessarily reliable.

SSDs sometimes make it worse, implementing their own abstractions over the top of what's actually going on so they can pretend to be regular hard drives with sectors and head travel and... On the plus side, if you take the route of working with the SSD directly, you can get a whole different set of guarantees.

There are no comments on this comment yet.