Re:Ask HN: Is there a data loss bug lurking in MS365 backup ...
by ryan87 on Wednesday September 06, 2023 @08:02PM
(#37413093)
> I do all of my work on local C:\ paths and copy files to SharePoint or OneDrive only if forced to collaborate with colleagues.
This is an option I considered, but it's harder for non-power users to deal with the file management. It's very likely some users would copy files instead of moving them and it would quickly devolve into trampling each other's changes.
That Dropbox article was great, so thanks. If I had to summarize my issue now, I'd say it feels like the backup solutions have a poorly implemented sync engine. I'm guessing they simply get a stream of changes from SharePoint though and I wonder if it would even be plausible to think they could misapply those changes.
Re:Ask HN: Is there a data loss bug lurking in MS365 backup ...
by jiggawatts on Wednesday September 06, 2023 @08:53PM
(#37413421)
A backup solution makes it into an even more complex sync configuration:
User <=> OneDrive => Backup
Multi-way synchronisation like that is full of landmines. I read a great article once about how a similar many-way, multi-master sync needs to be implemented. The context was LDAP directory synchronisation, but the concepts are similar.
Ah, there we go! It's their won fault for assuming a filesystem can be used for basic file and folder changes. /s
On a serious note, it turns out that replicated filesystems as seen in OneDrive or DropBox are hard to engineer. Astonishingly difficult to get right. "Formal proof verifiers" level of difficult, otherwise customers will lose data in everyday circumstances. It's happened to me, it happened to all of my coworkers, and it has happened to your customers.
Data loss with a poorly engineered replication system isn't some rare corner-case, it's the typical case, and it is a miracle if data isn't lost!
A few years ago DropBox rewrite their sync engine and wrote a great blog article about all the complex scenarios they had to handle: https://dropbox.tech/infrastructure/rewriting-the-heart-of-o...
OneDrive has done none of this. NONE. I guarantee it.
It loses data if you look at it wrong. If you call Microsoft Support they'll tell you not to look at it like that.
I do all of my work on local C:\ paths and copy files to SharePoint or OneDrive only if forced to collaborate with colleagues. This rare interaction with OneDrive causes data loss about 5% of the time, often enough that I notice.