News for hackers. Stuff that matters.
Re:MUSE: Relive and analyze your entire email archive by aw3c2 on Monday October 17, 2011 @04:00PM (#3122173)
There is no way I will let some third-party online tool access my inbox. Privacy and security are much more important to me than some fancy gimmick visualisation.

I would love to do this kind of analysis on my mails. Any chance for a local offline tool?

Re:MUSE: Relive and analyze your entire email archive by zandorg on Monday October 17, 2011 @04:06PM (#3122202)
I wrote software which scans a hard disk for email in any of 6 formats, converts them to Mbox (eg, standard, with emails one after another in plaintext), creates 2 indexes (full-text and SQL) then lets you search all your emails with a Lucene query (full text of email bodies) or an SQL query (MySql or PostGres or SQLite - SQL database of common email headers). It doesn't run on 'the cloud'; it's a Windows application.

An example search is 'All emails from "geocities.com" between March 2009 and April 2009, with attachments.

I haven't found anyone who wants such a program. Anyone here interested?

Re:MUSE: Relive and analyze your entire email archive by hachiya on Monday October 17, 2011 @06:32PM (#3122793)
For Linux users there is "notmuch" for full-text searching. http://notmuchmail.org

Uses the excellent Xapian library to perform just about any search you'd need.

Re:MUSE: Relive and analyze your entire email archive by inklesspen on Monday October 17, 2011 @05:55PM (#3122647)
Why mbox instead of, say, Maildir? The irreversible mangling mbox requires makes me reluctant to use it as an archive format.
Re:MUSE: Relive and analyze your entire email archive by zandorg on Tuesday October 18, 2011 @09:37AM (#3125094)
It can output single emails to folders named after months (eg, 2011_10_18), which I think is MailDir.
Re:MUSE: Relive and analyze your entire email archive by jzawodn on Monday October 17, 2011 @06:11PM (#3122707)
I'm interested too... [email protected] (since I've considered writing such a beast myself like a dozen times)
Re:MUSE: Relive and analyze your entire email archive by greyboy on Monday October 17, 2011 @04:20PM (#3122275)
Absolutely. It fits my usage nicely.
Re:MUSE: Relive and analyze your entire email archive by zandorg on Monday October 17, 2011 @04:24PM (#3122284)
If you're interested, we could talk over email.

Do you have an email address or do you want me to post my email address? Or not? ;-)

Re:MUSE: Relive and analyze your entire email archive by greyboy on Monday October 17, 2011 @04:36PM (#3122333)
I updated my profile to show it, I think.
Re:MUSE: Relive and analyze your entire email archive by a3_nm on Monday October 17, 2011 @06:51PM (#3122852)
Something like this was featured on HN a while ago: http://sluggish.homelinux.net/wiki/Emailgraph
Re:MUSE: Relive and analyze your entire email archive by james33 on Monday October 17, 2011 @04:13PM (#3122235)
The article says the tool runs locally.
Re:MUSE: Relive and analyze your entire email archive by nathanb on Monday October 17, 2011 @05:43PM (#3122602)
If you click on "Other accounts" at the top then you can point it at an mbox folder, if that's what you mean by "local offline".
Re:MUSE: Relive and analyze your entire email archive by mrsebastian on Monday October 17, 2011 @04:14PM (#3122236)
MUSE is a Java applet that runs locally.
Re:MUSE: Relive and analyze your entire email archive by a3_nm on Monday October 17, 2011 @06:48PM (#3122841)
> It’s sad but inescapably true: Your email inbox is your life.

I'm a bit surprised by the nostalgic tone of the first paragraph. Why is that supposed to be sad? I find it pretty cool, because it is so easy to keep an archive of every mail you send or receive, unlike paper mail.

Re:MUSE: Relive and analyze your entire email archive by djcb on Monday October 17, 2011 @06:12PM (#3122709)
I wrote 'mu' (http://www.djcbsoftware.nl/code/mu), which let's you index/search maildirs; I'm currently adding glue to use it as an emacs-based e-mail client as well (basically, something between wanderlust and notmuch).

Anyway, to get back on-topic, as an alternative way to analyse your mails, I've added guile (scheme) bindings, and it's pretty easy to get all kinds of interesting statistics from your mails -- see https://gitorious.org/mu/mu/blobs/master/toys/muile/README

Re:MUSE: Relive and analyze your entire email archive by frankydp on Monday October 17, 2011 @04:26PM (#3122290)
Does not seem to like Gapps.

Great application of the archive concept though.

Re:MUSE: Relive and analyze your entire email archive by jamesu on Monday October 17, 2011 @04:30PM (#3122306)
I'd love something similar for IRC logs. I know there are all those joke irc log analysers, but they seem to be mainly for channel logs.