News for hackers. Stuff that matters.
Re:Apple File System by lewisl9029 on Monday June 13, 2016 @04:02PM (#11897050)
That's what people were hoping for with ReFS from Microsoft, which released years ago, but that still hasn't happened yet.
Re:Apple File System by Analemma_ on Monday June 13, 2016 @04:11PM (#11897149)
btrfs was available in the Linux kernel in 2009, but didn't see production release in the tinkerer-friendly distros until 2012 and in an enterprise distro until 2015. These things take time: filesystems need to be absolutely bulletproof, especially in the consumer space where (unlike Linux) most users will have no idea what to do if something goes wrong. I'd say Microsoft is still on schedule.
Re:Apple File System by dmix on Monday June 13, 2016 @04:33PM (#11897359)
Speaking of which, is there any other good FS to use for desktop Linux (on an SSD on ArchLinux) or is Ext4 still the recommended standard?
Re:Apple File System by rleigh on Monday June 13, 2016 @05:44PM (#11897962)
Just yesterday, I did my first Linux installation with ZFS as the root/boot filesystem (Ubuntu 16.04). This is after using it as the default filesystem on my FreeBSD systems for several years, and being very happy with it.

I've used Btrfs many times since the start, and been burned by dataloss-causing bugs each and every time, so I'm quite cautious about using or recommending it. I still have concerns about its stability and production-readiness. If in doubt, I'd stick with ext4.

Re:Apple File System by mbakke on Monday June 13, 2016 @04:54PM (#11897550)
Depends on your needs.

Stability, reliability: ext4/XFS

CoW, snapshots, multi-drive FS: ZFS/btrfs

SSD speed, longevity: F2FS

Re:Apple File System by lighttower on Monday June 13, 2016 @07:17PM (#11898552)
I've had F2FS on an Android tablet for many years. Resurrected it. However I'm running Debian on my laptop and I'm scared to try f2fs on / Because i get warnings about it being not fully supported "yet" i would love to have an SSD optimized FS on Linux. Since AAPL will open source the release version, is it conceivable that AFS could replace ext4 as the default Linux FS?
Re:Apple File System by snaky on Monday June 13, 2016 @07:21PM (#11898572)
Do you think Apple will release it with GPL-compatible license?
Re:Apple File System by masklinn on Tuesday June 14, 2016 @03:39PM (#11904716)
Most Apple OSS stuff is released under Apache (Swift 2.2 is Apache 2), so probably?
Re:Apple File System by snaky on Monday June 13, 2016 @06:47PM (#11898377)
I think it could be mentioned that most of the features regarding CoW and snapshots could be provided by LVM these days.
Re:Apple File System by tbrock on Monday June 13, 2016 @07:45PM (#11898699)
Without getting stability and reliability correct don't bother with the other features. What good is it if the filesystem handles oodles of drives if none of them have any of the data you put on them?
Re:Apple File System by davidbanham on Monday June 13, 2016 @04:57PM (#11897572)
I use btrfs as my daily driver.
Re:Apple File System by qmr on Monday June 13, 2016 @04:47PM (#11897486)
XFS, ZFS, btrfs
Re:Apple File System by whorleater on Monday June 13, 2016 @04:10PM (#11897140)
Apple is far more willing to switch to more newer technologies than Microsoft is.
Re:Apple File System by drewda on Monday June 13, 2016 @06:10PM (#11898143)
... and Microsoft is far more willing than Apple to put effort into backwards compatibility.
Re:Apple File System by niccaluim on Monday June 13, 2016 @10:20PM (#11899324)
I don't know about that. Apple switched processor architectures twice, and both times software written for the old arch ran on the new one. And when they replaced their entire operating system, they not only made it so you could still program against the old API—just recompile and go—they also made it possible to run the old OS inside the new one so you could still run apps that hadn't yet been recompiled.
Re:Apple File System by duskwuff on Tuesday June 14, 2016 @01:03AM (#11899897)
And before that, when Apple made the 68k -> PPC transition in the mid-90s, they ran the whole system under a crazy, bizarre emulator that allowed for function-level interworking - 68k code could directly call PowerPC code, and vice versa. Early PowerPC systems were in fact running an OS that was mostly composed of 68k code; it wasn't until 1998 or 1999 (around the release of the iMac) that most of the Toolbox was ported to PowerPC.
Re:Apple File System by criddell on Monday June 13, 2016 @09:54PM (#11899239)
In the past, nobody did a better job of backwards compatibility than Microsoft.

Lately, Microsoft is showing that they aren't afraid to break things in the name of progress. If W10 is indeed the last version of Windows, maybe that's okay.

Re:Apple File System by Twisell on Tuesday June 14, 2016 @11:09AM (#11902453)
But wasn't that as the expense of clarity for new developers? I remember a horrible graduation exam where I had to code in VisualStudio.

The Most harsh part was not coding or UI, it was determining which version of different window API had a remote chance to smoothly work together. (It involved DB drivers and data grids)

Re:Apple File System by criddell on Tuesday June 14, 2016 @11:33AM (#11902663)
Perhaps. But I suspect there's a lot more extending and maintaining existing software than writing new software. For the former, backwards compatibility makes a huge difference.
Re:Apple File System by whorleater on Monday June 13, 2016 @06:16PM (#11898190)
I'm not saying Microsoft's approach is bad, just pointing out that there's a much higher chance of rapid adoption for this new filesystem.
Re:Apple File System by catwell on Tuesday June 14, 2016 @04:09AM (#11900527)
Also, NTFS being a much better filesystem than HFS+, there was a lot less incentive to switch.
Re:Apple File System by cordite on Tuesday June 14, 2016 @10:34AM (#11902232)
Too bad we still can't use NTFS flash drives on mac.

Although ExFAT is at least somewhat promising.

Re:Apple File System by mevile on Monday June 13, 2016 @05:39PM (#11897926)
One of the benefits of being vertically integrated.
Re:Apple File System by jug on Monday June 13, 2016 @06:10PM (#11898140)
OTOH Microsoft has a terrible track record of overpromising and underdelivering their next gen file system. I give Apple the benefit of doubt here. It is worded so that the limitations for the better part clearly sounds related to this being a preview release.
Re:Apple File System by joelg236 on Monday June 13, 2016 @04:39PM (#11897416)
Apple has (relatively, you can replace some harddrives) the most control on hardware, so at least from that perspective it's easier for them.
Re:Apple File System by zrm on Monday June 13, 2016 @04:56PM (#11897564)
Control over hardware doesn't really buy you anything here. Just about any hardware can use any filesystem with, in the worst case, the requirement that you have a small boot partition using the legacy filesystem.
Re:Apple File System by djcapelis on Monday June 13, 2016 @05:38PM (#11897912)
Interestingly with SSD storage devices, control of the hardware can help a lot more as it can become possible to categorize, fully explore and if needed, ensure a particular behavior of commands like TRIM. Other filesystems have the unenviable task of running on any random piece of storage you throw at it, including things where the firmware straight up lies, or the hardware delays non-volatility past the point the filesystem assumes (potentially producing data loss in a crash) or similar types of problems.

Anyway. Overall, I think it's safe to say hardware control doesn't make most of filesystem development much simpler or easier. But there's a few interesting places it arguably does!

Re:Apple File System by zrm on Monday June 13, 2016 @06:49PM (#11898395)
That doesn't really change anything about the filesystem design. A storage device can fail to write data it claims to have because of damage as well as design defects. When that happens, a reliable filesystem will detect it and a less reliable filesystem will catch on fire.

It also doesn't help to control 100% of the built-in storage if anybody can still plug in $GENERIC_USB_MASS_STORAGE_DEVICE and expect to use the same filesystem.

Re:Apple File System by 0x0 on Monday June 13, 2016 @06:27PM (#11898255)
Many filesystems exist that do not run on a "plain" read/write block device, because storage based on flash is more complicated than the old random-sector-access magnetic hard drives. See for example UBIFS and JFFS2 on Linux.

Having full and direct low-level control of on-board SSDs could very well be advantageous for performance and longevity of the flash on modern macbooks. Things like combining TRIM with low-level wear leveling etc.

Re:Apple File System by zrm on Monday June 13, 2016 @07:02PM (#11898467)
Taking advantage of the differences between flash and spinning rust only requires that you know which one you're running on.

Moving the wear leveling code into the OS where the filesystem can see it is an interesting idea but why aren't we doing that for all SSDs and operating systems then?

Re:Apple File System by 0x0 on Monday June 13, 2016 @07:20PM (#11898563)
(raw) flash and spinning rust are fundamentally different, because spinning rust drives provide a READ SECTOR and WRITE SECTOR primitive, while raw flash provides READ SECTOR, ERASE (large) BLOCK, WRITE (small) SECTOR primitives. Stuff like UBIFS do try to move the wear leveling code into the OS. But the big players like Windows' NTFS and Mac's HFS were originally designed for the spinning rust primitive, so I guess vendors of flash storage (SSD drives, USB sticks etc) had to deal with providing a translation layer to emulate the spinning rust primitives on top of the nand flash primitives. I'm sure various nand flash vendors have different characteristics / spare blocks / secret sauce / defects that are masked by proprietary firmware, and probably see a significant business advantage on keeping those secret. Even things like building smarts about how a FAT filesystem is likely to have heavy rewrites of the file allocation table compared to file contents, into the firmware for USB sticks where FAT is a likely fs, could prove an advantage. So being a single vendor behind the entire stack from the raw NAND flash memory to the motherboard it's soldered onto to the OS is likely very advantageous.
Re:Apple File System by zrm on Monday June 13, 2016 @08:53PM (#11899019)
They have their secret sauce so that legacy software can pretend the SSD is spinning rust. Let them.

Why shouldn't we also demand standard low level primitives so that every OS can do the thing you're describing?

Re:Apple File System by 0x0 on Monday June 13, 2016 @09:49PM (#11899208)
Of course a standard would be nice, but good luck getting everyone to agree on one before the end of the century :)
Re:Apple File System by throwwit on Monday June 13, 2016 @10:23PM (#11899341)
Already implemented in faster DSP from what I gather... http://arstechnica.com/apple/2011/12/apple-lays-down-half-a-...
Re:Apple File System by cmurf on Tuesday June 14, 2016 @05:37PM (#11905519)
Apple's EFI firmware has an HFS driver built into it. The way today's macOS boots is the firmware reads the bootloader off the boot partition created these days on Core Storage installations, and the bootloader (more correctly OSLoader) is what enables the firmware pre-boot environment to read core storage (encrypted or not) and thus find and load the kernel and kext cache and then boot.