News for hackers. Stuff that matters.
Re:Vboxsf fixes for 5.14-1 by Santosh83 on Monday July 19, 2021 @06:28AM (#27880941)

   As the person who tested the latest ntfs3 patchset, and had tested
   many of those iterations in the past, I would really like to see
   this *finally* land in Linux 5.14.
  
   However, I get the feeling it's not going to make it for 5.14 *or*
   5.15, and it seems like Paragon became discouraged by the lack of
   feedback on the latest revision.
   
   I know that compared to all you awesome folks, I'm just a lowly
   user, but it's been frustrating to see nothing happen for months
   with something that has a seriously high impact for a lot of people.
   
   It's a shame, because the ntfs3 driver is miles better than the
   current ntfs one, and is a solid replacement for the unmaintained
   ntfs-3g FUSE implementation.
Seriously, such a well funded, high profile project like Linux should be more receptive to key QoL improvements and drivers. NTFS is the de facto filesystem for portable data storage, much as I wish an open alternative was there. I hope they speed up the merge of ntfs3 into the mainline.
Re:Vboxsf fixes for 5.14-1 by yakubin on Monday July 19, 2021 @06:33AM (#27880968)
> NTFS is the de facto filesystem for portable data storage

I thought it was FAT32. Do Macs support NTFS?

EDIT: It seems they don't out of the box: <https://www.howtogeek.com/236055/HOW-TO-WRITE-TO-NTFS-DRIVES...>

EDIT 2: Since many comments replied with the same thing, I'll reply here: I wouldn't consider read-only support as support for portable data storage, since that allows you only to send data in one direction. When you want to copy a file from a Mac to a Windows computer, NTFS is not a solution now (out of the box at least), therefore falls pretty short wrt "portable".

Re:Vboxsf fixes for 5.14-1 by nullify88 on Monday July 19, 2021 @06:38AM (#27881009)
exFAT is probably better in terms of cross platform compatibility and addresses a lot of the limitations of FAT while remaining portable. Since Snow Leopard OS X is able to read and write out the box. Linux natively supported from kernel 5.4. Windows supports it from updated XP and onwards.

I not sure of Android compatibility though.

Re:Vboxsf fixes for 5.14-1 by squarefoot on Monday July 19, 2021 @08:16AM (#27881761)
> exFAT is probably better in terms of cross platform compatibility and addresses a lot of the limitations of FAT while remaining portable.

Still it is a shame that we're kept back literally decades when it comes to file exchange due to corporate culture polluting every corner of IT. Ensuring file export options plus file formats full documentation, should be among the most important requirements any software should satisfy to be even considered for professional use.

Re:Vboxsf fixes for 5.14-1 by tharkun__ on Monday July 19, 2021 @02:01PM (#27885494)
I agree with your want. Wholeheartedly.

Alas you are right in that this culture is all over Corporate World (yes not just America). Vendor lock-in is something that's been with us since forever and I doubt it will ever go away. They might have gotten better at hiding it from obviously being spotted but that's about it and in some other cases it's still just as clear as always but the marketing people are still very good at selling it to customers.

Re:Vboxsf fixes for 5.14-1 by salamandersauce on Monday July 19, 2021 @07:06AM (#27881202)
Android is annoyingly hit and miss. It's dependent on whether the device manufacturer wants to pay Microsoft royalty fees for it. So some devices do support it just fine and others don't. Often if a device has a microSD card slot and says it only supports 32GB cards it doesn't support exFAT since SDXC made the default file system for 32GB+ cards exFAT.
Re:Vboxsf fixes for 5.14-1 by jychang on Monday July 19, 2021 @08:36AM (#27881933)
Microsoft exFAT patents expired in 2019, I think. It's included in the Linux kernel since 5.7 or some version around then. Android devices support exFAT depending on which Linux kernel version they have.
Re:Vboxsf fixes for 5.14-1 by salamandersauce on Monday July 19, 2021 @10:08AM (#27882800)
Maybe that will change in the future but most Android devices are not using a 5.x kernel yet. All my Samsung devices support exFAT and use Android 11 with a 4.14 kernel. My old BB Priv also supported exFAT with Marshmellow which definitely did not have kernel version 5!
Re:Vboxsf fixes for 5.14-1 by Asmod4n on Monday July 19, 2021 @09:01AM (#27882164)
The patents didn’t expire in 2019, Microsoft just allowed Linux to use them without fear of getting sued.
Re:Vboxsf fixes for 5.14-1 by nolok on Monday July 19, 2021 @09:30AM (#27882435)
And Microsoft ACTIVELY went against Android manufacturers to get licensing fees a decade or so back, so those that didn't want to pay are much more likely to have a hard ban on exfat in place that will take time to overcome even after Microsoft opens it
Re:Vboxsf fixes for 5.14-1 by cassianoleal on Monday July 19, 2021 @06:46AM (#27881055)
> addresses a lot of the limitations of FAT while remaining portable

Whilst at the same time missing a very important feature for portable storage - a journal.

Re:Vboxsf fixes for 5.14-1 by tssva on Monday July 19, 2021 @07:56AM (#27881581)
Journaling can have significant downsides when used with external flash storage including reduced performance and increased wear of the flash memory.
Re:Vboxsf fixes for 5.14-1 by cassianoleal on Monday July 19, 2021 @08:00AM (#27881620)
Not disputing your facts, but I've used journalled file systems in flash drives since forever and never had a performance issue that was not directly tied to the hardware, and most have lasted many years.

I prefer having to replace a cheap flash drive more frequently than to lose data altogether.

Of course, everybody's use case is different and tradeoffs need to be considered.

Re:Vboxsf fixes for 5.14-1 by anthk on Monday July 19, 2021 @01:49PM (#27885359)
UDF is the "secret" multiplatform FS there. Even under OpenBSD you can use udftools and write pretty fast to any external USB storage.
Re:Vboxsf fixes for 5.14-1 by nullify88 on Monday July 19, 2021 @03:44PM (#27886551)
Oh I forgot about UDF. Easy to forget since the GUIs dont usually make it an option when formatting.

Unsure about Android and ChromeOS compatibility.

Re:Vboxsf fixes for 5.14-1 by polar on Monday July 19, 2021 @06:48AM (#27881067)
Is exFAT's reputation for data loss/corruption unwarranted?
Re:Vboxsf fixes for 5.14-1 by wila on Monday July 19, 2021 @09:56AM (#27882695)
Not really. FAT32 is very simple and normally has a copy of each FAT table stored as well. When something goes wrong with the first FAT table, there's a reasonable chance you can still use the 2nd copy. [1]

ExFAT is much more complex and AFAICT it does not have a 2nd copy of all of its data. [2]

Anecdotal evidence is that I personally lost data on ExFAT file systems, but also have had many customers with problems when they figured to use ExFAT for my backup products. If I see ExFAT in a support bundle than -by default- my suggestion for fixing issues is to reformat to a different file system. More often than not, that's the end of the open support case.

[1] https://www.ntfs.com/fat-mirrow.htm

[2] https://www.ntfs.com/exfat-overview.htm

Re:Vboxsf fixes for 5.14-1 by blarg1 on Monday July 19, 2021 @07:20AM (#27881318)
I had an external harddrive with exfat that lost all its partition information.

Worked one day, then few days later plugged it in and it was all gone.

Re:Vboxsf fixes for 5.14-1 by GoblinSlayer on Monday July 19, 2021 @07:49AM (#27881534)
Just write all your data twice, lol.
Re:Vboxsf fixes for 5.14-1 by simonh on Monday July 19, 2021 @08:13AM (#27881739)
If one of them becomes corrupt in a non-obvious way, how do you know which it is? You need three copies to be sure.
Re:Vboxsf fixes for 5.14-1 by Zambyte on Monday July 19, 2021 @08:22AM (#27881816)
Or you could save a hash as well
Re:Vboxsf fixes for 5.14-1 by alias_neo on Monday July 19, 2021 @09:12AM (#27882263)
What if a bit flips in your hash file and changes that? Now you need to store your hash a bunch of times too!

I kid, this is what I do. I've recently been backing up my family photos/videos to various media and I've been hashing each file and storing a hash file alongside the media to compare to in the future.

Re:Vboxsf fixes for 5.14-1 by cerved on Monday July 19, 2021 @07:10AM (#27881230)
no, not journaled
Re:Vboxsf fixes for 5.14-1 by aasasd on Monday July 19, 2021 @07:24AM (#27881355)
Just recently I brought a Mac-formatted exfat flash drive to a print shop, where it failed at being read on a Windows box. I doubt it that they're using WinME.
Re:Vboxsf fixes for 5.14-1 by vbezhenar on Monday July 19, 2021 @07:42AM (#27881472)
It might be an issue with partitioning. ExFAT support built in from Windows 7 and requires service packs for earlier versions.
Re:Vboxsf fixes for 5.14-1 by pschastain on Monday July 19, 2021 @08:47AM (#27882029)
OS X/macOS used to have some serious issues with exFAT but they may have been addressed in the few years since I last used exFAT on a Mac. Something to double-check before using the pair to store critical data.
Re:Vboxsf fixes for 5.14-1 by OverAndAbove on Monday July 19, 2021 @07:39AM (#27881454)
exFAT is HORRIBLE. Sorry for the caps. Interoperabiliy between Windows and Mac is hit-or-miss. Formatting on Windows and it's random if Mac can read it. Unplug without ejecting and expect to wait hours for Mac to analyse and fix, or plug-in and out and in and out of Windows and hope it fixes it. Many times a day. Zero problems with NTFS.
Re:Vboxsf fixes for 5.14-1 by vbezhenar on Monday July 19, 2021 @09:54AM (#27882672)
Mac does not support NTFS writing out of the box. This alone makes NTFS not suitable as an universal format.
Re:Vboxsf fixes for 5.14-1 by anthk on Monday July 19, 2021 @01:49PM (#27885367)
Try UDF.
Re:Vboxsf fixes for 5.14-1 by simias on Monday July 19, 2021 @06:37AM (#27880999)
FAT32 doesn't support files bigger than 4GiB, that's a huge limitation these days. But I don't disagree that calling NTFS "portable" is a bit of a stretch, although hopefully that'll change if good quality open source drivers become available.
Re:Vboxsf fixes for 5.14-1 by ulzeraj on Monday July 19, 2021 @08:09AM (#27881708)
A bit of personal experience: I've needed to create a Windows 10 installer from a MacOS computer a few weeks ago. Without the MS helper program I've figured I should perform the following steps:

1- download iso

2- format usb with fat32

3- copy the data

Apparently you can't just dd the ISO file into the USB block device like every other Linux or BSD ISO. It need to be FAT32 to be able to boot through UEFI.

The issue however is that the .wim file containing the OS installation source is bigger than 4GB. I think its sources.wim but I'm not sure. I had to install some command line utility from brew that did the job of "optimizing" the WIM file and managed to reduce it to a file bellow 4GB.

What does optimizing means? Better compression? Cleaning up crap inside the image? If their ISO tool probably does this without user interaction then why include a file bigger than what the FS can handle in the first place?

I don't know if this counts as some kind of dark pattern or MS being really antiquated in terms of bootable flash drivers.

Re:Vboxsf fixes for 5.14-1 by vbezhenar on Monday July 19, 2021 @09:56AM (#27882694)
What I'm doing is just using GPT partitioning, creating one NTFS partition and copy all files there. All my computers were able to boot in UEFI mode from this USB drive and successfully install Windows. With Linux it was a bit more cumbersome, but most Linux distros are hybrid ISOs anyway, so it's not as big issue. I know that UEFI BIOS is not obligated to support NTFS partitions, but my little practice they do.
Re:Vboxsf fixes for 5.14-1 by ulzeraj on Monday July 19, 2021 @10:23AM (#27882935)
Good to know that this is an option but from MacOS I don't have NTFS write capabilities. I think ExFat is available so I might try two partitions one being the EFI ESP and the second containing the rest of the install files.
Re:Vboxsf fixes for 5.14-1 by freeone3000 on Monday July 19, 2021 @08:51AM (#27882057)
It's a case of it working fine on Windows, so, there's no need to bother supporting anything else.
Re:Vboxsf fixes for 5.14-1 by beermonster on Monday July 19, 2021 @06:48AM (#27881069)
NTFS has journaling,compression, encryption, max 255 character filenames, max partition size is hundred of TB rather than 2GB, generally faster performance wise.

Trouble is , FAT32 has more OS compatibility.

Would be nice if Linux did have first class support for NTFS as it’s superior. But right now for maximum compatibility you need FAT32

Re:Vboxsf fixes for 5.14-1 by gattilorenz on Monday July 19, 2021 @09:34AM (#27882478)
> max partition size is hundred of TB rather than 2GB

FAT16 is limited to 2GB, FAT32 can extend to 2TB (but the max file size for a single file is 4GB, as the parent stated)

Re:Vboxsf fixes for 5.14-1 by sascha_sl on Monday July 19, 2021 @07:16AM (#27881284)
> max 255 character filenames

it doesn't in spec, that's just the win32 API

Re:Vboxsf fixes for 5.14-1 by jasode on Monday July 19, 2021 @07:49AM (#27881538)
>it doesn't in spec, that's just the win32 API

NTFS filename length is limited to 255 Unicode chars.

You may be thinking of full path lengths of 32,767 Unicode chars but the filename component is still limited to 255.

If you look at the NTFS data structure "$FILE_NAME (0x30)" at byte offset 0x40: https://www.google.com/search?q=ntfs+%22%24FILE_NAME%22+byte

... there's only 1 byte used to describe the filename length. Hence max of 255 chars.

Wikipedia page about NTFS also mentions 255 max length for filename: https://en.wikipedia.org/wiki/NTFS

Re:Vboxsf fixes for 5.14-1 by ziml77 on Monday July 19, 2021 @07:54AM (#27881569)
You're confusing the filename length limit with the limitation on the entire path length in the Windows API. NTFS allows paths to be up to 32k characters long, but each path component tops out at 255 characters.
Re:Vboxsf fixes for 5.14-1 by wyuenho on Monday July 19, 2021 @07:35AM (#27881423)
The Paragon driver cannot recognize encrypted NTFS volumes AFAIK
Re:Vboxsf fixes for 5.14-1 by shoo_pl on Monday July 19, 2021 @06:44AM (#27881039)
It's actually exFAT thats portable. NTFS is mostly for windows users, and macs do support it - though only reading.
Re:Vboxsf fixes for 5.14-1 by harry8 on Monday July 19, 2021 @06:52AM (#27881098)
Anyone know why? Given ext2 has had a public domain implementation for more than a decade? Is it because windows & mac won't support ext2 even for free? Seems like a better lowest common denominator fs than any of the fats?
Re:Vboxsf fixes for 5.14-1 by shikoba on Monday July 19, 2021 @06:59AM (#27881152)
You can't use easily ext2 on an external storage because of permissions.
Re:Vboxsf fixes for 5.14-1 by MisterTea on Monday July 19, 2021 @07:44AM (#27881496)
That's because Linux and OSX ignore NTFS permissions making it work more like FAT.

Plug an existing NTFS drive from one Windows system into another Windows system and you get a similar issue where opening a home directory requires you to take ownership.

Re:Vboxsf fixes for 5.14-1 by shikoba on Thursday July 22, 2021 @07:51AM (#27917797)
But Linux refuse to ignore permissions on an ext2.
Re:Vboxsf fixes for 5.14-1 by harry8 on Monday July 19, 2021 @07:10AM (#27881240)
Isn't that how it's mounted that matters there?
Re:Vboxsf fixes for 5.14-1 by shikoba on Thursday July 22, 2021 @07:50AM (#27917791)
I never find an option to ignore permissions.
Re:Vboxsf fixes for 5.14-1 by cerved on Monday July 19, 2021 @07:13AM (#27881258)
that depends, exFAT lacks permissions and symlinks. I think FreeBSD has NTFS support but lacks exFAT
Re:Vboxsf fixes for 5.14-1 by AnIdiotOnTheNet on Monday July 19, 2021 @07:36AM (#27881434)
> that depends, exFAT lacks permissions and symlinks.

The lack of permissions is why it works as a portable file system. If you've ever tried to use, say, ext for this it becomes clear why nobody does that.

Re:Vboxsf fixes for 5.14-1 by boring_twenties on Monday July 19, 2021 @08:52AM (#27882072)
You can just pass -o uid=X,gid=Y when mounting ext2 to solve this.
Re:Vboxsf fixes for 5.14-1 by knuthsat on Monday July 19, 2021 @06:41AM (#27881023)
I have no idea if I did something, but after MacOS 11 upgrade it seems to automatically mount my NTFS drive.

I do know that FUSE MacOS stuff seems to be disabled in brew.

Re:Vboxsf fixes for 5.14-1 by gattilorenz on Monday July 19, 2021 @09:31AM (#27882448)
This has been true for a long time. Does it mount it r/w or read only?
Re:Vboxsf fixes for 5.14-1 by knuthsat on Monday July 19, 2021 @03:20PM (#27886313)
Interesting. Previously I had to run the mounting command manually ever since I remember trying to mount an NTFS drive.

It's read only.

Re:Vboxsf fixes for 5.14-1 by 3np on Monday July 19, 2021 @06:40AM (#27881018)
IN my mind it has been exFAT for the past several years.
Re:Vboxsf fixes for 5.14-1 by Macha on Monday July 19, 2021 @07:00AM (#27881159)
Buy an external hard drive or USB stick, unless it's marketed as "for Mac", it's going to ship formatted as NTFS.
Re:Vboxsf fixes for 5.14-1 by yakubin on Monday July 19, 2021 @07:21AM (#27881329)
IME most external hard drives and USB sticks are marketed as compatible with both Windows and Mac, and ship formatted with FAT32. But maybe I'm the odd one here.
Re:Vboxsf fixes for 5.14-1 by salamandersauce on Monday July 19, 2021 @07:25AM (#27881358)
Most these days ship as exFAT.
Re:Vboxsf fixes for 5.14-1 by evgen on Monday July 19, 2021 @08:57AM (#27882127)
Literally NONE of the 100s of Tb I have purchased over the past year in formats ranging from SD card to USB stick to SATA drives have been formatted as NTFS. None of them.
Re:Vboxsf fixes for 5.14-1 by cerved on Monday July 19, 2021 @07:09AM (#27881225)
memory cards are FAT32
Re:Vboxsf fixes for 5.14-1 by piskov on Monday July 19, 2021 @06:43AM (#27881036)
Macs support NTFS in read-only mode out of the box. For writing you need tools like Paragon NTFS.
Re:Vboxsf fixes for 5.14-1 by rolleiflex on Monday July 19, 2021 @06:41AM (#27881031)
They do, but only to read, not write. I think the current up to date recommendation for cross-OS compatibility on external drives is to use ExFAT, though I believe the concept of the ‘external drive’ itself should be deprecated.
Re:Vboxsf fixes for 5.14-1 by fabiomaia on Monday July 19, 2021 @07:45AM (#27881501)
> though I believe the concept of the ‘external drive’ itself should be deprecated

why?

Re:Vboxsf fixes for 5.14-1 by rolleiflex on Monday July 19, 2021 @08:08AM (#27881695)
I think they’re problematic because they’ve reached ungodly amounts of storage and I don’t think most non-technical people fully understand how much of a loaded gun a non-regularly-backed-up 2TB external HDD is.

As a real world example, I’ve had to help recover my aunt’s 5-year-old 2TB HDD that she dropped several times and had no backup of, and by helping I mean confirming she probably lost a terabyte plus of data unless she wants to pay five digits USD to pay to a recovery company for a way less than 100% recovery. She is a highly educated professional (a MD) and yet, it did not even occur to her that the drive will not only might fail, but rather, will fail.

To quite a lot of non-technical people an external drive appears to be the safest form of storage, considering its being physically visible and movable. The closest analogy is storing money under the pillow versus a in bank, in all the good and bad ways.

Re:Vboxsf fixes for 5.14-1 by CapsAdmin on Monday July 19, 2021 @06:37AM (#27880995)
Yeah, you need to use FAT32 if you want to make a cross os portable drive.
Re:Vboxsf fixes for 5.14-1 by wumpus on Monday July 19, 2021 @06:41AM (#27881030)
> NTFS is the de facto filesystem for portable data storage

I've never seen it used that way, guess I'm weird.

One hopes that the people who do use it will work on it, but given the patent fiasco with exFAT, I wouldn't either look at or use the code, personally.

Re:Vboxsf fixes for 5.14-1 by vanderZwan on Monday July 19, 2021 @07:38AM (#27881448)
I dual boot between Linux and Windows on my laptop, and I use three physical hard drives: two SSDs, each dedicated to a different OS, and one hybrid HDD with more storage that's "shared" between the two (and also used as a simple way off passing data between them).

Maybe things have changed now but NTFS was the only reliable option for that last drive when I first set things up this way a few years ago.

Re:Vboxsf fixes for 5.14-1 by rkagerer on Monday July 19, 2021 @07:43AM (#27881484)
Me neither. I'm not sure what's up with all the talk here about NTFS for portable storage. If "portable" is meant as in USB key, I've never encountered one formatted that way. If it's portable as in a disk in an enclosure, then I suppose I can follow the rationale.
Re:Vboxsf fixes for 5.14-1 by pjc50 on Monday July 19, 2021 @08:48AM (#27882033)
> well funded

Is it? The kernel has a billion users who pay $0 for it. Most of the work is done by volunteers still. Oracle and RedHat have a few people looking at it full-time, and then Linus himself. This patchset is maintained by a third-party, Paragon, who also have an NTFS-for-Macs solution.

Hence:

>> We simply don't have anybody to funnel new filesystems

Also I see the new polite kernel is going well: https://lore.kernel.org/lkml/YO8LOKR%[email protected]...

Re:Vboxsf fixes for 5.14-1 by shp0ngle on Monday July 19, 2021 @09:04AM (#27882185)
Linux is on every Android phone. You can argue whether it's "real linux" or not, but that is besides the point with respect to filesystem drivers?

(I don't have a clue what does Android actually use for filesystem drivers, but I would _guess_ it's just Linux down there.)

Re:Vboxsf fixes for 5.14-1 by pjc50 on Monday July 19, 2021 @09:10AM (#27882247)
> Linux is on every Android phone

Yes, and almost all consumer routers and quite a lot of other random pieces of hardware. Hence the billions of users.

How many of those pay for upstream maintainers?

> I don't have a clue what does Android actually use for filesystem drivers

"Yaffs" or "sparse" (which is just fancy ext2). https://source.android.com/devices/bootloader/images ; most Android kernels will also have exfat so they can use SD cards and USB sticks.

Re:Vboxsf fixes for 5.14-1 by pmontra on Monday July 19, 2021 @07:43AM (#27881483)
Portable means that you can stick a USB pendrive in your car, speaker, TV, printer and be able to at least read the media on it. exFAT or FAT32 are the standard here, not NTFS.

Computers are easier to deal with, there might be obscure programs that can read and write any known file system format despite what the kernel supports.

Re:Vboxsf fixes for 5.14-1 by xxs on Monday July 19, 2021 @06:41AM (#27881027)
>NTFS is the de facto filesystem for portable data storage

That would be either FAT32 or exFAT

Re:Vboxsf fixes for 5.14-1 by 2muchcoffeeman on Monday July 19, 2021 @08:10AM (#27881716)
Way back there was a contributor Con Kolivas, that made scheduler improvements to make desktop computing nicer. But he quit because they never gave priority to desktop stuff. I remember back then it was not uncommon for your mouse cursor to just freeze and then come back to life.

The kernel group has different priorities to end users

Re:Vboxsf fixes for 5.14-1 by specialist on Monday July 19, 2021 @08:48AM (#27882032)
That's rough. I've had similar experiences.

TDLR: Needful, worthy improvements require champions. A thankless role. And few of us have the resources and tenacity to serve the champion role for the long haul.

In trying to understand organizational psychology and apparent apathy, I keep thinking of Stephen Jay Gould's theory of "punctuated equilibrium" meets the attention economy.

Metaphorically, organizations (and people) are information processors. Attention is our scarcest resource. We're all doing triage, at every level. Just trying to cope with the torrent of information, discerning signal from noise. Trying to prioritize efforts.

So it's almost inevitable that needful, useful, worthy things remain neglected, undone. Even in the absence of pushback.

Until some kind of crisis. When the neglected thing suddenly becomes very important.

Cue the fire drill. Something must be done.

The champion must be watchful, ready, proactive. Seize that very brief opportunity to sneak in their needful improvement. Ahead of the all the spazs pitching their weird and wrong and ignorant reactive proposals.

The only winning strategy is to just keep pushing. Patiently, diplomatically. Be that useful thing that everyone's dimly aware of.

"Oh, wasn't Con Kolivas working on that mouse jitter thing? Ya, I heard it's pretty good. Ah, it's ready to go? Cool, let's do it."

If your needful thing is truly worthy, be confident that eventually it'll percolate to the top of the triage stack.

This game truly sucks. But I don't see how it could be any other way with our current decision making structures.

Re:Vboxsf fixes for 5.14-1 by touisteur on Monday July 19, 2021 @01:30PM (#27885162)
You'll need someone working almost full time on this (like Jens Axboe on io_uring). I'm wondering whether it's some emergent behaviour to make sure you'll maintain the thing on the long-term and not just dump the thing on a subsystem guy and see ya!
Re:Vboxsf fixes for 5.14-1 by tomxor on Monday July 19, 2021 @08:33AM (#27881904)
> NTFS is the de facto filesystem for portable data storage

No, that would be exFAT and FAT32. Some form of FAT is basically supported by everything, which is why if anything is the "de facto" for portability, it's FAT. FAT is the netBSD of FS.

Re:Vboxsf fixes for 5.14-1 by puzzlingcaptcha on Monday July 19, 2021 @08:33AM (#27881903)
As everyone seems to be fixated on pendrives and FAT, consider also that virtually every Linux-based consumer-grade NAS needs to support R/W NTFS. Typically it was through FUSE with considerable loss of performance/efficiency.
Re:Vboxsf fixes for 5.14-1 by Denvercoder9 on Monday July 19, 2021 @08:55AM (#27882106)
> consider also that virtually every Linux-based consumer-grade NAS needs to support R/W NTFS

Do they? I don't think egress/ingress from external drives is an essential feature for consumer-grade NAS.

Internal drives are typically formatted with a Linux-native filesystem and accessed through SMB/Samba from Windows machines.

Re:Vboxsf fixes for 5.14-1 by puzzlingcaptcha on Monday July 19, 2021 @09:06AM (#27882213)
> I don't think egress/ingress from external drives is an essential feature for consumer-grade NAS

Is it not? I think most consumer NASes on the market support NTFS-formatted external drives (be that USB or eSATA) and need a r/w capable driver.

Re:Vboxsf fixes for 5.14-1 by tomxor on Monday July 19, 2021 @08:39AM (#27881952)
The parent said "de facto filesystem for portable data storage", NAS for Windows is a very specific use case. For data portability, compatibility and wide adoption matters, and that is undoubtedly where FAT and it's variants rule.
Re:Vboxsf fixes for 5.14-1 by TickleSteve on Monday July 19, 2021 @06:37AM (#27880998)
Are you confusing NTFS with FAT32?

NTFS is pretty much limited to internal drives on Windows PCs.

Re:Vboxsf fixes for 5.14-1 by piskov on Monday July 19, 2021 @06:40AM (#27881021)
Considering the userbase, everyone formats using NTFS (if they want files more than 4GB), so it’s de facto standard due to the sheer quantity.

ExFat is great cross-option, though, without the limitations of fat32.

Re:Vboxsf fixes for 5.14-1 by darkwater on Monday July 19, 2021 @06:55AM (#27881115)
Android SD cards userbase is probably comparable or even bigger nowadays. And those use fat32 or exFAT AFAIK.
Re:Vboxsf fixes for 5.14-1 by zeusk on Monday July 19, 2021 @07:01AM (#27881162)
I'd guess not since big G has been on the push to abolish external storage - and I wouldn't blame them, really hard to put data (especially application data) on hotplug removable storage.

The camera world has been using exFAT since quite a while.

Re:Vboxsf fixes for 5.14-1 by CTOSian on Monday July 19, 2021 @07:09AM (#27881229)
ext3 is way more portable... even under *BSDs .. "NTFS... de facto standard"? ... from M$ lolz
Re:Vboxsf fixes for 5.14-1 by anthk on Monday July 19, 2021 @01:53PM (#27885409)
Ext3 sucks under BSD's, a lot of them can't write to the volume, doesn't matter either EXT2, 3, or 4.

UDF as I stated works fine with udfclient under OpenBSD and it could be "mountable" even with base tools (read /usr/local/share/doc/pkg-readmes/udfclient in order to correctly format it with udfclient).

I copied files back and forth on USB drives written in under OpenBSD and the volumes mounted like magic under Linux. And the performance is not bad at all.

Re:Vboxsf fixes for 5.14-1 by CTOSian on Wednesday July 21, 2021 @04:24AM (#27903764)
I will give a try to UDF -esp if has comparable write speeds with ext3 , but for sure I had no issues to _write_ on an external ext3 with NetBSD + FreeBSD (my last desktop OS, before move to Debian Sid)
Re:Vboxsf fixes for 5.14-1 by EastToWest on Monday July 19, 2021 @08:56AM (#27882113)
Linux is well funded in the sense that corporations put big money looking after their own interest in the kernel. Anything outside of their respective areas of interest? Good luck.

Paragon, for better or worse, is just yet another corporation. They shouldn't really expect other corporations or volunteers to care much about their code, other than the fact that their code may break others'.

Now that they have Linus' blessing, they can just send a pull request. The work paid off in the end.

Re:Vboxsf fixes for 5.14-1 by cout on Monday July 19, 2021 @06:54AM (#27881107)
Can you explain what you mean by "portable data storage"? I'm used to hearing the word "portable" used to mean "cross platform", but if it is not supported well under Linux, then given how widely used Linux is, I would think ntfs would not count as cross platform.
Re:Vboxsf fixes for 5.14-1 by Sebb767 on Monday July 19, 2021 @07:23AM (#27881352)
I'm pretty sure that the grandparent meant portable quite literally, as in you can take it with you. Things like USB sticks, external hard drives, sd cards etc..
Re:Vboxsf fixes for 5.14-1 by cout on Monday July 19, 2021 @08:01AM (#27881631)
That was the impression I was getting, hence my question. But since thumb drives typically come preformatted in either FAT32 or exFAT, I thought maybe there was a third possible use of the word "portable" that I am unfamiliar with.
Re:Vboxsf fixes for 5.14-1 by Delk on Monday July 19, 2021 @11:08AM (#27883468)
External hard drives with larger capacities and potentially larger files might be a use case for NTFS. While it isn't fast, ntfs-3g has worked fine for basic use for me. Someone said in another comment that ntfs-3g is unmaintained, though, which was news to me, and obviously not a great thing if true.

I suppose exFAT might be a viable option for larger external drives as well due to its higher file size limit. None of the other commonly used file systems (including native Linux file systems) seemed easy to use from both Linux and Windows the last time I looked into it.

Re:Vboxsf fixes for 5.14-1 by Macha on Monday July 19, 2021 @07:01AM (#27881167)
Honestly ntfs-3g is fine. It's slow, which I'd always blamed on NTFS since NTFS is also clearly slow for large directories of small files on Windows also, but apparently this new driver is better in that regard.
Re:Vboxsf fixes for 5.14-1 by tasogare on Monday July 19, 2021 @06:58AM (#27881139)
Linux on the desktop (where portability of file system matters) is 2% at the very best. Hardly what one would call "widely used".
Re:Vboxsf fixes for 5.14-1 by ksec on Monday July 19, 2021 @08:36AM (#27881938)
>Seriously, such a well funded, high profile project like Linux should be more receptive to key QoL improvements and drivers.

I guess politics gets in the way?

Re:Vboxsf fixes for 5.14-1 by EastToWest on Monday July 19, 2021 @08:43AM (#27881997)
Not necessarily politics. It could be purely due to lack of interest from maintainers and reviewers.
Re:Vboxsf fixes for 5.14-1 by beermonster on Monday July 19, 2021 @06:43AM (#27881038)
> NTFS is the de facto filesystem for portable data storage

FAT32 needs to be used if you want to maximise portability

Re:Vboxsf fixes for 5.14-1 by anthk on Monday July 19, 2021 @01:54PM (#27885414)
UDF if you don't care about printers or Android.
Re:Vboxsf fixes for 5.14-1 by m-p-3 on Monday July 19, 2021 @08:13AM (#27881736)
Personally I've seen more ExFAT volumes on external storage in the wild than NTFS nowadays.
Re:Vboxsf fixes for 5.14-1 by arbitrage on Monday July 19, 2021 @07:09AM (#27881228)
> NTFS is the de facto filesystem for portable data storage,

are you high right now? 'cause you sound like you're on drugs when you say things like that.

Re:Vboxsf fixes for 5.14-1 by dang on Monday July 19, 2021 @04:20PM (#27886864)
Hey can you please stop posting unsubstantive comments and breaking the site guidelines? We ban that sort of account. I don't want to ban you but we've had to ask you about this before.

If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and sticking to the rules when posting here, we'd be grateful.