News for hackers. Stuff that matters.
Re:Introducing the Infinit file system by deprave on Sunday May 01, 2016 @01:27PM (#11606997)
This looks really great and I love the direction. Hopefully they're working on making it more consumer-friendly. ;)

Questions:

1. They say that "While most solutions (Dropbox, GlusterFS, OwnCloud etc.) store your files unprotected in the cloud or on a specific server, we took a diametrically opposed direction by relying heavily on encryption. Whenever a file is stored in Infinit, it is cut into chunks, every chunk is encrypted with a unique key (AES-256) and stored, providing both encryption at rest and in transit."

Isn't that actually a lot like Dropbox? (https://www.dropbox.com/en/help/27)

2. How stable is FUSE for OS X? Last time I used it (couple of years) was for SSHFS and it was unstable and crashed the machine every now and then.

Re:Introducing the Infinit file system by philjohn on Sunday May 01, 2016 @02:06PM (#11607172)
Dropbox deduplicate content ... so a file that several people have uploaded is only actually stored once.

They also allow you to access your files over a web interface, and no decryption happens "in browser". So yes, DropBox most certainly have the decryption keys. Your data is protected at rest, and on the wire using TLS, but it's not end-to-end encryption.

Re:Introducing the Infinit file system by astrodust on Monday May 02, 2016 @04:38AM (#11609997)
Do you have any reference to their de-duplication system?
Re:Introducing the Infinit file system by michaelmior on Monday May 02, 2016 @09:09AM (#11610989)
There is a blog post[0] which references deduplication. But apparently this may have been disabled[1].

[0] https://blogs.dropbox.com/dropbox/2011/07/changes-to-our-pol...

[1] http://webapps.stackexchange.com/questions/54633/does-dropbo...

Re:Introducing the Infinit file system by hlieberman on Sunday May 01, 2016 @01:30PM (#11607009)
I think the big difference they're implying (though I haven't been able to actually /verify/ the implication yet) is that Dropbox holds the keys to decrypt that content. Infinit doesn't.
Re:Introducing the Infinit file system by JadeNB on Sunday May 01, 2016 @01:38PM (#11607040)
> though I haven't been able to actually /verify/ the implication yet

Honest question: how would you verify such a thing? Even if you audit the code, once they open-source it, how do you know that what you see is the same as what they run on their end? (Or do you mean 'verify' just in the informal sense of having them state that that is what they mean, rather than in some more formal trust-free sense?)

Re:Introducing the Infinit file system by wtbob on Sunday May 01, 2016 @02:10PM (#11607186)
> Even if you audit the code, once they open-source it, how do you know that what you see is the same as what they run on their end?

If it's actually secure, then the only thing which matters is what I run on my end, since the key would be generated on my end and the chunks would be encrypted on my end. If I send a server my data, then the system cannot be secure.

Re:Introducing the Infinit file system by hlieberman on Sunday May 01, 2016 @01:53PM (#11607096)
The first seems more important (no sense going through all the work of verifying something is true before making sure the authors are actually stating it!), but, both, really.

In the latter case, you'd look at the software that /you/ run to validate that:

1. It's using some sane form of key generation. 2. It's actually using those keys to perform encryption on the files prior to them being transmitted. 3. The original files, as well as the key material, aren't read anywhere else in the code base not necessary to do the above two.

Then, only run that version of the software. It's non-trivial, and generally expensive. This is why a lot of people prefer tools which call out to other trusted programs to actually handle the key management and encryption. Less complicated code to audit that way. (cf tarsnap)

Re:Introducing the Infinit file system by deprave on Sunday May 01, 2016 @01:31PM (#11607014)
I see, that wasn't clear to me, thank you!
Re:Introducing the Infinit file system by ccrone on Monday May 02, 2016 @07:07AM (#11610475)
Sorry that I'm late to this thread!

The first question appears to have been answered by others but I will add that even though Infinit is currently closed source, you can build your infrastructure without using the Hub. The Hub is just in place to make it easy to fetch user public keys, network and volume descriptors and endpoints at runtime. You can do this manually using the CLI (--export/--import instead of --push/--fetch).

We're using the 3.x branch of FUSE for OS X and haven't had an issue with it yet.

Re:Introducing the Infinit file system by notacoward on Sunday May 01, 2016 @09:01PM (#11608620)
The part about GlusterFS storing files unencrypted is untrue, BTW. We've had full at-rest encryption using client-only keys for years before they came along. Makes me wonder how many of their other "original ideas" are just failure to do basic research before jumping in to make a buck.
Re:Introducing the Infinit file system by nickpsecurity on Sunday May 01, 2016 @10:19PM (#11608867)
I was going to agree but decided to load up web site to be sure:

https://www.gluster.org/

I don't see a list of features at all here or an obvious link to them. Most sites have something like this (see "Why Sector/Sphere?"):

http://sector.sourceforge.net/

Or this:

http://lustre.org/about/

Wait, that one almost sucks as much as GlusterFS site. It could also use a page detailing exactly what it can and can't do with obvious link on front-page. At least it had obvious link and basic description, though.

So, hard to judge writer of recent post on what features were in GlusterFS, etc if their page doesn't go through the trouble to list them without us having to dig. I'd have to point two fingers. Fortunately, Wikipedia to rescue doing what site didn't do:

https://en.wikipedia.org/wiki/GlusterFS

Note: Oh shit, it still doesn't mention encryption. Not in the comparison or list of distributed filesystems either. Still undocumented for casual researcher.

Re:Introducing the Infinit file system by notacoward on Monday May 02, 2016 @07:22AM (#11610519)
Let me Google "GlusterFS encryption" for you.

http://www.gluster.org/community/documentation/index.php/Fea...

https://www.gluster.org/community/documentation/images/e/e2/...

...and more. I think that still falls under "casual research" ... besides which, implementers and promoters should be doing more than casual research anyway. The fact that the Gluster documentation sucks doesn't change that. Plenty of others have implemented such end-to-end encryption as well, and the trend is already increasing. (I find that quite gratifying BTW since I felt like a lone voice in the wilderness when I was writing about the importance of keeping keys on the clients five-plus years ago.) What they present as a differentiator is very much a me-too nowadays so, again, it calls their other claims of originality or uniqueness into question.

Re:Introducing the Infinit file system by nickpsecurity on Monday May 02, 2016 @10:15AM (#11611523)
Why would I Google GlusterFS encryption? You think a casual researcher should type every feature of importance into Google with an apps name to confirm if it has that feature? That's ridiculous. It's features or benefits should be easy to find on the homepage. Documentation, esp "What This Does," is critical to OSS success.

Here's what Gluster doc menu said: one that goes to instsllation page; more detailed installation; admin guide; developer guide; upgrade guide. Geez, I don't need any of that. Just want to know what the hell it does with what features.

They need to fix it.

Re:Introducing the Infinit file system by notacoward on Monday May 02, 2016 @01:29PM (#11613508)
If somebody is going to make a specific claim, in a published document, about another project having or not having a feature, then damn right they should Google for the combination. A lot of OSS projects end up having pieces of information scattered all over presentations and blog posts and who the hell knows what else. All of your goalpost-moving about what should be on the Gluster website doesn't change the fact that Infinit's characterization was inaccurate and trivially revealed as such by a single obvious Google search.
Re:Introducing the Infinit file system by nickpsecurity on Monday May 02, 2016 @02:47PM (#11614280)
You're semi-right here. People saying why their offering is better than competitors better know what the competition offers. Marketing 101 says dig deep to find that plus differentiators. That much I agree with.

That said, your excuse for GlusterFS site being screwed up is that other projects are screwups, too. Makes no sense. Let's put it into perspective: Gluster people could spend under 5 minutes typing up and posting that page. Instead, they expect all potential users or contributors to spend 10m-1hr digginh through docs for same information. Meanwhile, many FOSS pages state clearly what their software does.

So, no excuses. It's just laziness and foolish on top of that given they want more adoption of a tool they won't describe haha. The responsibility is on them to present their work in a clear way given that goal. They're failing on that right now.

Re:Introducing the Infinit file system by notacoward on Monday May 02, 2016 @03:23PM (#11614657)
It's easy to criticize when you've never worked on the kind of infrastructure that Gluster has. Yeah, for a project I'm doing all by myself it would take all of five minutes to update the web page with that sort of information. Hey look, that's exactly how it happened when this was part of a project I was doing myself.

http://pl.atyp.us/hekafs.org/

Now, on a huge project with the website and docs with separate owners subject to their own detailed standards and review processes, it's not that easy. Even as one of the Gluster project architects, it would take me more than a few minutes to make even a trivial change, and that would be time taken away from other tasks for which my personal expertise is even more necessary. Yes, it's a problem - one shared to varying degrees by most projects of this scale. Here's the fantastically informative website for the Linux kernel.

https://www.kernel.org/

They don't have links to specific features on the front page, either. Good luck finding the docs about XFS project quota, starting from there. Would it be responsible for me to claim it doesn't exist, based only on what I can get by clicking around on kernel.org? I could come up with similar examples for many features on Apache or Mozilla or OpenStack projects as well. The fact is that technical debt exists for documentation as well as for code, and keeping it all coherent becomes exponentially more difficult as the project grows.

But none of that has anything to do with the original point. What's the point of complaining about Gluster here? How could you possibly believe that's helpful, unless you believe people should be grateful for every moment of your attention? This story is about Infinit. Let's keep the focus on them, and their claims, and whether those claims are accurate.

Re:Introducing the Infinit file system by nickpsecurity on Monday May 02, 2016 @10:34PM (#11617428)
"It's easy to criticize when you've never worked on the kind of infrastructure that Gluster has. "

It's easy to critize if I've ever done one essay, research paper, marketing piece, commercial project... many things where I took the time to document and explain what I was presenting. Often in an ad hoc was as it was a secondary focus. I don't have to work on a specific product to understand a common skill or requirement.

"Here's the fantastically informative website for the Linux kernel."

"based only on what I can get by clicking around on kernel.org? I could come up with similar examples for many features on Apache or Mozilla or OpenStack projects as well. "

You cite an example from a group that famously doesn't give a damn what people think which also expect people to know what their project is already. Also an outlier in general. Then some others whose sites at least explain what they do with key features. Unlike Gluster. You grasped at straws more than I expected.

"Hey look, that's exactly how it happened when this was part of a project I was doing myself."

You did exactly what I'm asking them to do. More actually. Your site supports my position albeit half the links in the paper/slides set didn't work. Maybe it's NoScript but one or two told me what I needed to know. How about some examples of how easy it is on big, collaborative projects:

https://www.freebsd.org/about.html

http://www.xtreemfs.org/all_features.php

http://toolkit.globus.org/toolkit/about.html

https://owncloud.org/features/

(OwnCloud since the OP blog post mentioned it as a competitor.)

"But none of that has anything to do with the original point. "

Your original point was that the author should've been responsible enough to do research, identify key features of Gluster, and consider them before making claims in the post. You also argued against Gluster site author(s) needing to be responsible enough to identify the key features and list them on the website for people like author doing research. You then made excuses for them despite that being quite easy and considered good practice. So, I'm addressing both the poor research by Infinit author and poor docs by Gluster that contributes to it, along with your double standard on the topic. I'm adding counter-examples to sites in and outside their domain with varying organizations and team sizes to show how they could improve.

Had they had good materials to draw on, I'd have never argued with your claim that author should've known what features they do or don't have. Or maybe if you slammed them for irresponsibility as you did the author. Seemed to be a bias, though, along with OSS documentation problem worth noting.

Re:Introducing the Infinit file system by fezz on Monday May 02, 2016 @02:12PM (#11613916)
LTFS is based on FUSE and has support from all the major tape vendors. It's been pretty stable so far but does have some speed limitations.