News for hackers. Stuff that matters.
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @10:20AM (#6152131)
Bjarni here, lead dev. Happy to answer any questions.
Re:Mailpile: Let’s take email back by mkl on Saturday August 03, 2013 @10:58AM (#6152256)
"Mailpile is a modern web-mail you run on your own computer."

I think this sentence should be the first thing anyone sees when they go to the page. The text at the moment assumes everyone already knows roughly what Mailpile is, so I didn't figure it out until I read HN comments.

Also, are there screenshots somewhere?

Re:Mailpile: Let’s take email back by jspaetzel on Saturday August 03, 2013 @04:45PM (#6153337)
I think that this sentence needs to be gotten rid of completely. - Webmail is fundamentally not something that can run on your own computer. The word is "web" mail, not desktop mail, it's just going to confuse users.

In addition to it being confusing, because of dynamic IPs and residential port blocking you may be able to run it on your computer, you just won't be able to do anything with it due to other internet infrastructure... - Sending mail from home is almost guaranteed to fail sometimes/often, due to dynamic ip ranges which are frequently blocked. - Port 25 and port 80 are blocked by most major american ISPs these days for residential services. Making this unusable from a home server. Not to mention it's against many ISPs terms of service to run a server from home without paying for a business package. (That's right, it's not just google fibre) - SPF records and other forms of email authentication? You would also need a third party DDNS service if using a dynamic IP.

So with all of that said, I like the interface pictures. It could be a good competitor to webmail clients like roundcube and friends.

Re:Mailpile: Let’s take email back by alextingle on Sunday August 04, 2013 @05:11AM (#6155109)
> Sending mail from home is almost guaranteed to fail...

It's an MUA - it can sent mail just as well as any other MUA. Use your ISP's smarthost if you are using it from home.

> Webmail is fundamentally not something that can run on your own computer.

This statement is plain wrong, even if by "your own computer" you really mean "your desktop box". I can run any server I like on my desktop box. If it has a well designed installer, then it would be as easy to set up as a "normal" app - the end user might not ever know the technical details.

> The word is "web" mail, not desktop mail, it's just going to confuse users.

Now I do agree with you. The product seems to be a little bit of both, so there is some potential for confusion. "Web-mail you run on your own computer" does seem to explain it pretty well though.

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @12:28PM (#6152517)
Brennan was working on getting some screenshots uploaded. We are obviously very busy reloading everything at the moment. ;-)
Re:Mailpile: Let’s take email back by jeffbr13 on Saturday August 03, 2013 @10:22AM (#6152142)
Are there any plans to help make setting up your own mailserver easier? That seems to be the main challenge for anyone who wants to self-host right now.
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @10:24AM (#6152148)
That is one of our main long-term goals. It's too early to say exactly how we would do that, but odds are there would be some sort of helper service in the cloud which relays and handles DNS and such. We need to get the client built first though.
Re:Mailpile: Let’s take email back by jeffbr13 on Saturday August 03, 2013 @10:29AM (#6152159)
And what would be your approach to spam-filtering? One of Google Mail's strengths is that it can use data from millions of accounts' emails to train its spam-filter.

Do you see Mailpile offering some way to do the same thing in the future, with clients flagging spam and the result being used to train a 'community' filter?

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @11:13AM (#6152304)
This is still largely an open question. But there are some interesting possibilities for those who actually make their Mailpile visible on the public web - Mailpiles could talk to each other and exchange data of this sort. But ideally things like this would be a community effort shared between projects and we would join, not necessarily lead.
Re:Mailpile: Let’s take email back by alextingle on Sunday August 04, 2013 @05:26AM (#6155128)
If encrypted & signed mail becomes common enough, then I suspect the spam problem goes away. I suspect spammers won't want to sign their mail, and if they do, it would be trivial to distrust new public keys and maintain a global blacklist of bad established ones. Then almost all encrypted mail can be simply trusted, and spam filtering only has to pick out the occasional real message from the unencrypted dross.
Re:Mailpile: Let’s take email back by guygurari on Saturday August 03, 2013 @11:03AM (#6152273)
I applaud your efforts! I did not see mobile mentioned. Will there be a mobile-friendly version of the web client? Will there be IMAP access from (e.g.) mobile devices? (Under 'Current Features' you mention IMAP, but I did not understand if this refers to you acting as an IMAP client or server.)

By the way, there seems to be a copy-paste typo in the description for 'Spam Detection'; it reads 'PGP encryption and verification of emails and recipients'.

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @11:08AM (#6152289)
Yes, making the web mobile friendly is definitely on the list of things to do. Native apps may come later, once the APIs have stabalized a bit. The current IMAP support is functioning as an IMAP client, we haven't started work on the server side yet. And thanks for the typo report :)
Re:Mailpile: Let’s take email back by alternize on Saturday August 03, 2013 @11:50AM (#6152418)
so if i understand you comment right: it will be a MUA that accessed through a webbrowser, and one still needs to have an IMAP capable email-account somewhere else?
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @12:59PM (#6152594)
Yes, at least to begin with, we are not providing people with domains or e-mail addresses. IMAP, POP3, or run your own SMTP server...
Re:Mailpile: Let’s take email back by unhammer on Sunday August 04, 2013 @03:37AM (#6154985)
sigh … I already have email clients that do PGP on my email that is hosted on Someone Else's Computer. It doesn't seem like Mailpile moves me a single step away from the dragnet.

When I saw the "pagekite" username on github, I immediately hoped for plug-and-play self-hosted IMAP/SMTP. Here is what I envisioned in the blissfully ignorant moments until I read what the project was actually about:

The user gets to download/buy a USB stick image / raspberry pi SD image. After plugging it into a pi or other box and turning that on, user types in the URL "mailpile" on their laptop web browser and on first run, user gets asked by web app to plug in a big harddrive for storing email on[1]. The box runs some IMAP server (dovecot?), connected to some MTA that does TLS (postfix?). The user has paid for an already setup domain name, kept in sync with the IP address of that box (which runs a dyndns-like daemon), user also gets access to some server that relays SMTP without breaking TLS (since most mail servers will not accept SMTP from just any dynamic IP). So on first run, the user also has to enter the credentials for the service they paid for, these credentials are used to let the box get its SSL key signed by the CA, tell the dyndns service that this box gets to update this domain name etc.

Now if two users run this, they don't even need PGP to communicate in an encrypted way, it looks just like any other sent email. Nor can anyone requisition their mail without breaking into their house.

So the paid service would be to get a dyndns-updatable domain name with SSL, and access to some server that relays SMTP. The service would have to dole out domain names and either be a CA itself, or be able to intermediate in the SSL key signing process.

[1] For bonus points, dejadup runs there and user gets to say "send encrypted backups to dropbox/some ssh account/some other USB drive"

Re:Mailpile: Let’s take email back by HerraBRE on Wednesday August 07, 2013 @05:46PM (#6175872)
This is one of the directions the project could go in, and I personally would like it if that happened. But first we have to build the software, right? :-)
Re:Mailpile: Let’s take email back by alternize on Saturday August 03, 2013 @05:29PM (#6153475)
but then I'm not really seeing what the advantagess over running thunderbird + engimail locally or using roundcube (which also has openpgp support built in) would be?
Re:Mailpile: Let’s take email back by alextingle on Sunday August 04, 2013 @05:14AM (#6155111)
Why would this MUA need to behave as an IMAP server?
Re:Mailpile: Let’s take email back by barend on Saturday August 03, 2013 @11:23AM (#6152342)
Your introductory text and video mention the NSA and PGP. The PGP system has been around for a long time without getting any mainstream traction. There are numerous reasons for this failure, but the general complexity of public key crypto has to be one of them.

On the project page you write

> An intuitive, modern user interface makes strong security accessible to everyone.

Can you share a bit more about the way you envision this?

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @12:39PM (#6152547)
Big, big topic. I suggest you follow our Twitter account or something, we'll probably be blogging about this later on in the campaign.
Re:Mailpile: Let’s take email back by susi22 on Saturday August 03, 2013 @10:56AM (#6152246)
Not a question but a comment: You should add an igg link to the github README. Some people link to github projects instead of the website.

Good luck!

Re:Mailpile: Let’s take email back by gingerlime on Saturday August 03, 2013 @11:59AM (#6152444)
What's an "igg link"?
Re:Mailpile: Let’s take email back by mikkow on Saturday August 03, 2013 @12:21PM (#6152500)
Indiegogo link
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @01:01PM (#6152596)
Yes, very good point. :)
Re:Mailpile: Let’s take email back by alecco on Saturday August 03, 2013 @11:33AM (#6152371)
Thank you! will donate today.

What about perfect forward secrecy for server connections?

What about transparent text compression?

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @01:20PM (#6152643)
Sounds like those are out of scope, that's just down to correctly configuring the SSL server. But yeah, I hope we correctly configure our SSL servers. ;-)
Re:Mailpile: Let’s take email back by rhizome31 on Saturday August 03, 2013 @11:51AM (#6152420)
Why AGPL rather than a more liberal license like BSD or MIT?

Edit: Just to clarify why I'm asking this, the project looks very interesting and I suppose the choice of AGPL wasn't made lightly, as it might slow down adoption by commercial organizations, so I'm interested in the reasoning behind this choice.

Re:Mailpile: Let’s take email back by alecco on Saturday August 03, 2013 @01:26PM (#6152654)
In an ideal world BSD/MIT would be the best choice.

But in the current startup world several aynrandian douchebags would take it and make web services or paid apps. Put a lot of money on viral marketing. Pester them with feature requests. And never, ever contribute back to the community or acknowledge it helped their business.

I know a famous BSD developer who switched to *GPL because of this. Also, search for tptacek's explanation. It's counter-intuitive but this is the best license at the moment, mostly for reasons Stallman didn't forsee.

Re:Mailpile: Let’s take email back by nhaehnle on Saturday August 03, 2013 @01:52PM (#6152739)
It's counter-intuitive but this is the best license at the moment, mostly for reasons Stallman didn't forsee.

Aren't the reasons you outline in your comment exactly (a subset of) the reasons that Stallman foresaw?

Re:Mailpile: Let’s take email back by alecco on Sunday August 04, 2013 @03:05PM (#6156678)
>> Also, search for tptacek's explanation. It's counter-intuitive but this is the best license at the moment, mostly for reasons Stallman didn't forsee.

I was referring to tptaceck's reasons in the previous sentence you missed to quote.

Re:Mailpile: Let’s take email back by nhangen on Saturday August 03, 2013 @01:57PM (#6152758)
what does Ayn Rand have to do with any of this?
Re:Mailpile: Let’s take email back by alecco on Sunday August 04, 2013 @03:08PM (#6156685)
Sociopaths rationalizing themselves as titans of some kind. Economic superheros who shouldn't be bound to basic tit-for-tat rules. Rules even the most primitive cultures follow.
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @12:33PM (#6152531)
This is something we have debated extensively. Our main goal is to improve privacy and security on-line - giving cloud providers yet another free tool with which to build proprietary services and lock in more users and their data feels like it would be counterproductive.

However, we are open to discussing, and if a significant fraction of our backers would prefer a more liberal license we will probably switch.

Re:Mailpile: Let’s take email back by alecco on Saturday August 03, 2013 @01:27PM (#6152658)
Please stay AGPL. It's the right choice for these times.

BTW, beware of code ownership of pull requests from corporations.

Re:Mailpile: Let’s take email back by pixelcort on Saturday August 03, 2013 @05:58PM (#6153578)
Regarding Pull Requests, this is quite important if and when you want to change licenses, or dual license.

Make sure you have on file release forms for every copyright holder who submits code that grant you permission to relicense later on. For one line bug fixes it can be a pain, but it's worth it.

One problem with this though is that it places an unfair advantage with the current maintainer. A fork of the project wouldn't inherit the relicensing permissions from all the contributors.

Re:Mailpile: Let’s take email back by icebraining on Saturday August 03, 2013 @06:46PM (#6153725)
Ugh, why? You're just discouraging people from contributing by forcing them to accept that their code might be used in a matter they don't approve of in the future.
Re:Mailpile: Let’s take email back by binarycrusader on Sunday August 04, 2013 @03:25AM (#6154972)
Because it prevents a choice of more liberal licensing later.

Ogre3D was able to successfully transition from LGPL to MID/BSD because of contributor agreements.

The Apache Software Foundation, Free Software Foundation, and others all require contributor agreements for very good reasons.

If your projects starts out with very liberal licensing, it's not necessary strictly speaking (unless you're concerned about patents). But that's the tradeoff.

Re:Mailpile: Let’s take email back by nhaehnle on Sunday August 04, 2013 @07:28AM (#6155325)
It might also discourage contributors who don't want a transition to a different license. After all, contributor agreements also give the power to go closed source later on.
Re:Mailpile: Let’s take email back by binarycrusader on Sunday August 04, 2013 @09:01PM (#6157820)
Like I said, tradeoffs. LLVM for example doesn't require copyright assignment, but does require a contributor agreement for patent purposes for significant contributions.

Contributor agreements are a necessary mechanism to protect the project and ensure its future when dealing with patents or preparing for the potential of relicensing.

Re:Mailpile: Let’s take email back by icebraining on Sunday August 04, 2013 @05:36AM (#6155144)
Yeah, but the Apache Foundation already has a permissive license, and nobody expects the FSF to re-license a project, except maybe to a new version of the same.

By choosing the (A)GPL but forcing contributors to grant relicensing rights, you've excluded both those who consider copyleft licenses non-free, and those who consider copyleft licensing an important requirement.

Re:Mailpile: Let’s take email back by binarycrusader on Sunday August 04, 2013 @09:00PM (#6157817)
Did you miss the part where I mentioned patent agreements which is another good reason why Contributor Agreements are important?

And while the Apache Foundation already has a "permissive license" it's not quite as permissive as BSD / etc.

And if the Apache Foundation wants to relicense, to say, a future version of their license, they're still going to potentially need that contributor agreement.

Again, as I said before, there are tradeoffs.

Re:Mailpile: Let’s take email back by andrewcooke on Saturday August 03, 2013 @10:51AM (#6152230)
how does the search work? is there a separate database? i use mairix (which does construct a separate database) and it's pretty damn awesome. have you looked at that? are re-inventing something worse? sometimes it is useful to search just the body. and mairix works fine with a huge volume of mail.

also, getmail is python and does pop and imap downloads, so could be used there.

[otherwise, this seems awesome and if i run out of my own dumb ideas i will seriously consider contributing]

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @11:10AM (#6152295)
It is a custom search engine, written in Python. It works surprisingly well, most queries are answered under 200ms and tens of milliseconds are common once caches are warm.
Re:Mailpile: Let’s take email back by Freaky on Saturday August 03, 2013 @10:44PM (#6154372)
Hundreds of milliseconds across how large an index?

My email corpus is on the order of ten million messages. Needless to say, seeing the words "can index roughly four messages per second" made me cringe rather hard.

Re:Mailpile: Let’s take email back by beachstartup on Saturday August 03, 2013 @11:46AM (#6152404)
any plans for a solr support? there's a lot of knowledge out there on how to scale solr for large webmail deployments like i.e. inside a large company or for forensic mail analysis.
Re:Mailpile: Let’s take email back by rhizome31 on Saturday August 03, 2013 @12:37PM (#6152543)
I was wondering about that as well. Why not go with an existing search engine? Having checked out the code it seems that the project it still in its infancy. A lot of effort has probably gone into building the search engine though, which kind of seem like re-inventing the wheel but I'm sure you have reasons that I don't see. By the way, as test-infected coder, my first move was to launch the test suite, and it was a bit surprising that it wanted to run sudo :) I didn't go further for now because I don't have time to setup fetchmail, will do later. You guys seem to have a lot of potential and good intentions :) In my end of the world I'm also dreaming of "taking back email" and I happen to write Python for a living, so I'll be watching you guys very closely. Quite frankly though, I won't consider contributing until you have a proper test suite :) Keep it up!
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @01:14PM (#6152628)
Contributing increases the odds we'll be able to make the test suite. ;-) But yes, the code is very immature, right now it is basically a proof-of-concept in the middle of being refactored into its first sensible iteration (as mentioned at the top of the README).

I built the search engine from scratch initially because it was just an interesting problem I wanted to experiment with. However, now that I have one that works, I see massive benefits to not having too many external dependencies. It makes integration and packaging ever so much more pleasant.

Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @12:38PM (#6152545)
No plans at the moment. The design of Mailpile strongly implies a per-user index, so sharding by user is a very easy way to scale this up.
Re:Mailpile: Let’s take email back by alextingle on Sunday August 04, 2013 @05:18AM (#6155117)
Solr is written in Java. How is that compatible with something that's hassle-free for end users?
Re:Mailpile: Let’s take email back by Freaky on Sunday August 04, 2013 @09:36AM (#6155590)
Is Java really that much more effort to set up than Python? Solr's problem isn't Java, it's the bloaty mess of XML configuration files it insists on having - something like elasticsearch pretty much Just Works.
Re:Mailpile: Let’s take email back by joeyh on Saturday August 03, 2013 @10:32AM (#6152169)
Please fix the "it's" typo on your website ;)
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @10:32AM (#6152171)
Haha, noted. Thanks.
Re:Mailpile: Let’s take email back by eps on Saturday August 03, 2013 @11:04AM (#6152279)
> Smári is the director if the International Modern Media Institute

of

Re:Mailpile: Let’s take email back by ippisl on Saturday August 03, 2013 @11:06AM (#6152280)
What about anonymity ? email has a potential for better anonymity than TOR via mixmaster or other remailers. Are you considering those features ?
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @11:09AM (#6152290)
It's not on the roadmap yet, but that is why we want to build a community, to see what people want.
Re:Mailpile: Let’s take email back by ssp on Saturday August 03, 2013 @10:39AM (#6152185)
Do you have plans to make money off of this?
Re:Mailpile: Let’s take email back by M4v3R on Saturday August 03, 2013 @10:44AM (#6152204)
They've started an indiegogo campaign to fund the development.

http://www.indiegogo.com/projects/mailpile-taking-e-mail-bac...

Re:Mailpile: Let’s take email back by jerrac on Saturday August 03, 2013 @12:31PM (#6152520)
Any plans for .deb/.rpm repositories?
Re:Mailpile: Let’s take email back by HerraBRE on Saturday August 03, 2013 @12:34PM (#6152533)
Of course, but that's months away. We gotta write the software first!
Re:Mailpile: Let’s take email back by jerrac on Saturday August 03, 2013 @12:47PM (#6152571)
'Course it's months away. :) I've noticed that some applications don't offer their own repositories. So I've been left with either relying on the distributions out of date packages, or installing the application manually. That's why I asked. I'd rather use your repos so that I can keep it up to date.
Re:Mailpile: Let’s take email back by tmzt on Saturday August 03, 2013 @01:16PM (#6152636)
Another option is packaging it with docker (http://docker.io) so it could be dropped onto an existing system quickly.