News for hackers. Stuff that matters.
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by amelius on Wednesday January 04, 2017 @04:41PM (#13322318)
I wonder why we haven't seen good open-source imitations of Dropbox yet, and why there isn't a good open protocol for file sharing. The last such protocol I've heard of is WebDAV, but it seemed to have been neglected by OS implementers (Apple's implementation was particularly bad). Also WebDAV was missing many modern features.
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by 4rtemis on Wednesday January 04, 2017 @04:47PM (#13322359)
I agree, and by no means is it a replacement, but https://syncthing.net is pretty damn interesting if you want to control your own data. https://www.syncany.org [now abandonded] was a cool twist on the idea using cloud storage in a secure way.
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by LeoPanthera on Wednesday January 04, 2017 @05:03PM (#13322510)
I've been using SyncThing for a few years now and I'm mildly surprised that it is not more popular.

Though every time they release a new major version it breaks compatibility with the older major versions and this happens quite often. They need to stop doing that if they want mainstream adoption.

Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by danieldk on Thursday January 05, 2017 @04:18AM (#13325840)
I think SyncThing also has the wrong model for mainstream adoption: you have to fiddle with host keys that you need to add to every peer. Bittorrent/Resilio Sync's model of using shared RW/RO/encrypted keys per share is much more intuitive.

There seems to be one open source project that aims to implement Resilio Sync's model:

https://librevault.com

Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by rrdharan on Wednesday January 04, 2017 @06:59PM (#13323359)
File sync is one of those things that is easy to get 90% right and exponentially harder to get 99% right; there are a ton of edge cases especially when you introduce cross-platform and mobile apps and all that fun stuff.

It's actually a true bonafide distributed systems problem, where the implementation and service matter just as much as the specification.

Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by jeff_tyrrill on Thursday January 05, 2017 @01:13AM (#13325142)
The value that Dropbox provides isn't the sharing, nor the protocol - it's the failure-free merging algorithm (I intentionally said "merging" not "syncing"). The magic is what happens locally - not on the network.
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by amelius on Thursday January 05, 2017 @02:05AM (#13325319)
Interesting. Do they also merge file formats like .DOC and .PSD?
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by jeff_tyrrill on Thursday January 05, 2017 @07:34PM (#13332865)
Nope (though I'd love that). By "merging" I mean things like folder trees. But Dropbox gets so many nice details right that competitors and homegrown solutions tend not to think of:

* When syncing a folder tree (uploading or downloading), it transfers files smallest to largest (globally across all files queuing to sync, regardless of folder). This simple algorithm is remarkably close to optimal behavior.

* When modifying a small file while larger ones are syncing, the small file immediately cuts to the front of the line (even sub-file). This avoids situations where a large folder uploading or downloading prevents you from getting the utility of the quick syncing of small work files.

* Files deleted from the server or another computer are briefly retained on the client in a special folder before being deleted from local storage so that their contents can be matched to other incoming files. In other words, even for very complex folder move and file rename operations, if the new files contain the same data as the old ones in whatever permutations, the client will sort it all out without re-transferring actual file data.

* There are no data loss holes. All operations are on a files-first basis (not folder-first), and Dropbox will never decide that a file was intended to be deleted unless the client app explicitly observes deletion. You don't need to worry that offline renames or moves, even multiple conflicting ones from different machines will result in deletions when the Dropbox clients go back online.

* "No data loss holes" also applies to conflicts of a single file. If a file is modified in two different ways by offline clients, one file or the other will be renamed to make sure that a modification isn't lost.

* The Dropbox client never gets stuck requiring the user to "resolve conflicts". It picks the sanest thing to do and does it (always observing the "never lose data" principle). Syncing is delightful and never fails, not a chore to be dreaded and carefully planned for with a bunch of "conflict" choices, like all systems prior to Dropbox.

Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by niftich on Wednesday January 04, 2017 @04:46PM (#13322353)
Because most people pay them for the hosting, and the UI/UX is just a bonus.

There are plenty of open protocols for file sharing, like HTTP or SFTP. What unmet requirements do you envision?

Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by amelius on Wednesday January 04, 2017 @04:47PM (#13322361)
> What unmet requirements do you envision?

Well, for starters, automatic synchronization in the background.

Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by niftich on Wednesday January 04, 2017 @04:48PM (#13322366)
That's not a protocol, though. That's a userspace application.
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by amelius on Wednesday January 04, 2017 @04:50PM (#13322394)
I'm not sure if that is correct. I suspect that (efficient) synchronization needs some sort of protocol.
Re:Dropbox Could Have One of 2017’s Most Interesting IPOs by paulryanrogers on Wednesday January 04, 2017 @08:46PM (#13323997)
Owncloud and Nextcloud aren't a protocol, but they do support WebDAV and have Dropbox-like features.

EDIT: Fixed typo