News for hackers. Stuff that matters.
Re:2012 Personal Annual Report by arscan on Monday January 07, 2013 @11:45AM (#5021828)
What tools do you use to collect this data? Looks great, by the way.
Re:2012 Personal Annual Report by jehiah on Monday January 07, 2013 @11:47AM (#5021835)
a lot of it is just simple python scripts to download/convert data to csv files, and do some simple post processing.

for the computer activity i took a snapshot every 30seconds of what program was active, and how long my laptop was active.

Re:2012 Personal Annual Report by arscan on Monday January 07, 2013 @11:59AM (#5021896)
So you parse your credit card statements (or equivalent) for the coffee & travel costs? I thought the travel was by distance (not cost) at first, which is what I was curious about because it would require a more active role in logging on your part.

Is this purely for kicks, or are you trying to use it to drive behavioral changes (e.g. spend less on coffee)? I ask because I always think about doing this, but I get a stuck on the "why".

Re:2012 Personal Annual Report by jehiah on Monday January 07, 2013 @12:03PM (#5021919)
coffee data is more driven from foursquare checkins, and only partially credit card transactions.

The motivation for me is a way to learn about my year (not directly to change my actions), and part a fun exercise to get better at data processing, javascript, and UI Interaction/charting. I like the hard deadline that a personal annual report creates naturally (ie: it's no good if i release it in june).

Re:2012 Personal Annual Report by nphase on Monday January 07, 2013 @11:56AM (#5021880)
Are these tools open source?
Re:2012 Personal Annual Report by jehiah on Monday January 07, 2013 @12:00PM (#5021905)
The script I used for extracting sms/iMessages is here https://gist.github.com/4437883

Some of the other scripts just download data from foursquare's API, and post processing transaction download from Mint. Hopefully I'll have time to clean and post those scripts.

Re:2012 Personal Annual Report by mikeevans on Monday January 07, 2013 @01:38PM (#5022407)
I'd be interested in seeing the one(s) that keep track of application usage!
Re:2012 Personal Annual Report by jehiah on Monday January 07, 2013 @02:10PM (#5022572)
I've dumped the cron job i use for data collection here https://gist.github.com/4477372

My rough approach to post processing this data was to group by 6 minute intervals, and to drop any records where the computer was inactive for more than 120 seconds.

Re:2012 Personal Annual Report by lucaspiller on Monday January 07, 2013 @04:22PM (#5023333)
I've tweaked it a bit here https://gist.github.com/4478297

- Logs active website from Chrome

- Stores time including local timezone (interesting to see what timezones I'm in)

- File name includes hostname

Re:2012 Personal Annual Report by sbouafif on Monday January 07, 2013 @03:28PM (#5023045)
Many thanks for the script :)
Re:2012 Personal Annual Report by enobrev on Monday January 07, 2013 @01:49PM (#5022456)
For collecting application usage data, I used to use an application called Timesnapper ( http://www.timesnapper.com/ ), which takes a screenshot every x seconds and keeps track of the application title / etc, with the added benefit of allowing you to automatically categorize usage "Work", "Play", etc.

Found it really useful to be able to literally play back my day in 10 second intervals. Unfortunately it's windows-only. One of the very few apps I truly miss since moving to Linux almost 2 years ago.

-- I have absolutely no affiliation with TimeSnapper besides being a happily paying customer a couple years ago.

Re:2012 Personal Annual Report by gwern on Monday January 07, 2013 @08:38PM (#5024422)
You could use arbtt (http://www.joachim-breitner.de/projects#arbtt) and then just toss your favorite screenshot utility like ImageMagick into crontab set to fire every 10 seconds.
Re:2012 Personal Annual Report by enobrev on Tuesday January 08, 2013 @02:51AM (#5025284)
Definitely interesting, and I'll probably try it at some point should I find both the time and the inclination to do so. Admittedly, I paid for that application because I didn't want to implement it myself. But I'm glad there are some building blocks in place that would make rolling my own a relatively easy task. Thanks for the suggestion!
Re:2012 Personal Annual Report by perssontm on Monday January 07, 2013 @04:28PM (#5023368)
I think there is some package for ubuntu that tracked everything written on the keyboard, like a personal keylogger. It was mentioned on HN during december, cant find it now though.
Re:2012 Personal Annual Report by josyw on Monday January 07, 2013 @06:16PM (#5023882)
Re:2012 Personal Annual Report by neetij on Monday January 07, 2013 @11:48PM (#5024946)
Checkout LifeSlice by Stan James (https://github.com/wanderingstan/Lifeslice) for OSX - the script takes a screenshot, picture of the user and tracks web browser usage. The sample report leaves much to be desired from a design aesthetic but the data is available.