News for hackers. Stuff that matters.
Re:Dropbox Project Infinite by rsync on Tuesday April 26, 2016 @12:04PM (#11573011)
"This is actually very different than traditional network file systems like SMB, NFS, WebDAV, and SSHFS. With a normal network file system over the WAN you would have major latency problems trying to `cd` and `ls` the remote file system."

Is that still true for sshfs ?

People used to ask us if they should rsync to us directly or sshfs mount and then rsync to the mount, and we told them not to do that since the original rsync stat would basically download all files simply to look at them / size them.

But I don't think that's the case anymore. I think sshfs (or perhaps something about FUSE underneath) is smart about that now ... isn't it ?

Re:Dropbox Project Infinite by antoncohen on Tuesday April 26, 2016 @12:24PM (#11573203)
I haven't used FUSE SSHFS in around 8 years. I'm sure it has improved a lot since then. I could imagine it handling file listing and stat better than other network protocols (cd/ls over ssh works well over most WAN connections). It looks like it now caches directly contents too (https://github.com/libfuse/sshfs). It probably wasn't fair for me to include SSHFS in the list since I haven't used it in so long. I was troublesome when I used it.
Re:Dropbox Project Infinite by mrsteveman1 on Tuesday April 26, 2016 @02:29PM (#11574385)
> People used to ask us if they should rsync to us directly or sshfs mount and then rsync to the mount

Are you guys allowing full access to the machine now through LXC containers or some sort of VM?

Re:Dropbox Project Infinite by rsync on Tuesday April 26, 2016 @03:32PM (#11574841)
"Are you guys allowing full access to the machine now through LXC containers or some sort of VM?"

No - it is the customer, on the client side, that creates an sshfs mount representing their rsync.net account.

It works very well and it is very nice to have a plain old mount point that represents your rsync.net account - especially since you can just browse right into your historical ZFS snapshots, etc.

But in the past, people did that and they got the bright idea to rsync to that local mount point, to do their backups, and that didn't work well.

But my understanding is that nowadays it would work better - you wouldn't download every single file that rsync simply stat'd or listed ...

We still don't recommend it, though. No reason to add that complexity.