News for hackers. Stuff that matters.
Re:Syncer: fast stateful file/disk data syncer written on Go by LoSboccacc on Sunday September 20, 2015 @05:36AM (#10247016)
well I take 'written in go' is more than a warning than a bonus at this point, especially after looking at some similar tech and finding all this https://github.com/syncthing/syncthing/issues/9 (ended up using glusterfs in the end)

besides, this lib only cover one sync scenario and only one and does it only on demand. might be fast because it stores the hash somewhere, but that also means you'll run in issues if the mirrored slow drive content changes by any mean.

Re:Syncer: fast stateful file/disk data syncer written on Go by jerf on Sunday September 20, 2015 @11:31AM (#10247865)
You can get inotify-or-equivalent support in Go for specific OSes reasonable well with bindings (simple enough even to write your own if push came to shove), what's missing is a cross-platform, simple API. Which, arguably, is because it turns out that despite the problem sounding simple, a cross-platform, simple API is all but impossible. You can sort of get one for a single file or a single small directory with no recursive subdirectories, but beyond that, you're surprisingly boned.

This hasn't got much, if anything, to do with Go specifically; in particular, I've been aware of everything I write in this post since before I was even aware of Go. The OS support is just too variable and shot through with subtle-yet-critically-important semantic differences, in addition to the fact the problem is harder than it looks at first. Trying to write a lowest-common-denominator API leaves you with a really low LCD. Trying to write a higher level API that offers the more convenient stuff leaves you with an API that makes it trivially easy to write something that works really, really well on one platform and is completely non-performant on another (in particular, trying to automatically "recurse" on the directories). It turns out there's no happy middle here for the general case.

Re:Syncer: fast stateful file/disk data syncer written on Go by howeyc on Sunday September 20, 2015 @07:57AM (#10247224)
I don't see what your issue is with syncthing. syncthing is meant to be cross platform, so using inotify was an obvious problem.

Plus syncthing is an entirely different use case from glusterfs. Think Dropbox, not one-filesystem-across-many-machines.

Re:Syncer: fast stateful file/disk data syncer written on Go by LoSboccacc on Sunday September 20, 2015 @08:31AM (#10247280)
None at all with syncthing. It's awesome, but doesn't cover my use case. And symcthing does say "Syncthing replaces proprietary sync and cloud services with something open, trustworthy and decentralize" - except as you say it doesn't.