News for hackers. Stuff that matters.
Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by jeffbee on Wednesday August 04, 2021 @02:47PM (#28064680)
Where by "ultra fast" it is meant that it is much slower than a directly-attached SSD that occupies the same port.
Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by reacharavindh on Wednesday August 04, 2021 @02:53PM (#28064753)
Local storage and Networked storage always have their places. Local solid state storage almost always gets you better performance because you negate the overhead of network. Unless, you’re talking fancy arrays connected to saturate 100G NICs.

Local storage falls apart the moment you need that storage accessible from another machine…

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by jeffbee on Wednesday August 04, 2021 @03:33PM (#28065221)
This doesn't say anything about how such storage would be accessed by the mac and some other clients at the same time. It literally just runs iperf over tb. As a matter of architecture it leaves the question of whether it would be preferable to directly attach the storage to the Mac and export it to the rest of the network from there.
Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by SilverRed on Wednesday August 04, 2021 @09:04PM (#28068500)
Networked storage also falls apart the moment you need anything better than basic file storage. So many filesystem features do not work networked, most network file mounts do not support any kind of modern security and the ones that do are often super slow.

Everything has its place, but I wasted so much time trying to get a nas to work as storage for my home server.

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by reacharavindh on Thursday August 05, 2021 @04:04AM (#28071083)
Not to sound pedantic, but Local storage and networked storage are not alternatives. They satisfy different needs.

If you need reasonable access to your storage from more than one computer, you need networked storage(of any kind).

Alternatively, if you are running say a database server, and you know the primary storage could be local, it is ideal to choose better performing local storage and of course plan for backups to networked storage.

As much as I agree with your pain points of networked storage, it’s not like you can “replace” it with local storage everywhere.

I have dealt with a couple PB of networked storage for a research cluster. (FreeBSD+ZFS) over NFS on a dedicated network to a cluster of about 100 servers running recent versions of Linux. It worked like a charm while we admittedly kept things simple in terms of file system features.

All clients mount the appropriate NFS shares they need via autofs(only when they are needed).

ZFS being ZFS was just a marvel of software engineering, was solid as a rock. While giving us transparent compression, superb read caching in memory, and cheap snapshots.

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by genewitch on Wednesday August 04, 2021 @10:17PM (#28068994)
I have a Synology and use the iscsi feature for VMs that aren't even in the same building as the NAS, what sort of issues aren't solved in this sort of way?

Don't get me wrong I have nothing but problems with NFS and SMB access on the Linux clients. Windows works perfectly, as in whatever I set on the Synology is what I get on windows.

There's got to be a better way!

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by SilverRed on Wednesday August 04, 2021 @11:45PM (#28069625)
I found that there was basically nothing that I could find which would allow me to mount a filesystem as if it was natively connected securely over the local network without going to real enterprise stuff I either couldn't understand or didn't have the hardware for.

Everything I found was basically FUSE style things where it looks kind of like local storage but any time you want to use advanced features or high performance it would fail.

SSHFS was secure and easy to set up but was maxing out the CPU on my NAS and also did not support file permissions.

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by systemvoltage on Wednesday August 04, 2021 @04:49PM (#28066123)
Dumb question: Can you use Mac's shared folder for another machine to access files?
Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by filoleg on Wednesday August 04, 2021 @06:21PM (#28067194)
Yep, it is possible. Here is the official support page on how to set up a shared folder that would be accessible by a any machine using SMB[0], and here is one for access by a macOS machine[1] (that is a bit simpler for setting up certain advanced config options).

0. https://support.apple.com/guide/mac-help/share-mac-files-wit...

1. https://support.apple.com/guide/mac-help/set-up-file-sharing...

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by renewiltord on Wednesday August 04, 2021 @03:40PM (#28065289)
Well, yes, that is implied by the fact that it says “NAS” in the title.

In general, you can usually do faster local than over the network. People use a NAS for other reasons.

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by dylan604 on Wednesday August 04, 2021 @02:58PM (#28064811)
That SSD has 0 redundancy so you're trading the purpose of the NAS by going for speed. If that's what you want, then you're wasting time looking at NAS equipment anyways.

So what's your point?

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by CoolGuySteve on Wednesday August 04, 2021 @03:04PM (#28064883)
Most SSDs have a lot of redundancy in the form of multiple flash chips, it's just not exposed to you, the user, by the controller chipset.

There are also PCI-E x16 with multiple NVMe slots. There's nothing stopping some company from making something similar for Thunderbolt.

And I guess the cost is too high and the connectors would be too bulky, but it would be nice to have something like a SODIMM for flash that separates the memory from the controller.

Re:Ultra fast Thunderbolt NAS with Apple M1 and Linux by dylan604 on Wednesday August 04, 2021 @03:44PM (#28065344)
Are we really comparing the "redundancy" of an SSD internal workings to a NAS? You're reaching really far for that. Whatever "redundancy" an SSD has is whatever it needs just to present a single instance of that data to you. Sounds pretty damn ineffecient, but if that's what it takes to reliably get 1200MB/s speeds I'm okay with it for situations where I need that.

The redundancy a NAS can provide means losing an entire drive (or more depending on config) in the unit without data loss. Even with that failed drive, the data is still accessible. The failed thing can then even be replaced and the system can be brought back to the normal full redundant state. Your "redundancy" of an SSD doesn't allow for that to happen.

I feel like I'm actually feeding trolls with this