uuid
One suggestion: Your use case is well defined. Don't get thrown off by people in here suggesting millions of features.
"All stores support key expiration, but only memcache supports it natively. All other stores emulate expiration." Redis doesn't support volatile keys??
Also, does it allow access to a DB's tuning parameters? It makes a great difference whether to use Tokyo's B+ tree database or its hash database ...
CON - even if things work now, they can and will break in the future (removed hardware support etc)
- every update takes time and work
- don't even think about running it on the hardware you already have - only use specifically built systems (such as those linked)
- backups aren't as nice as on a mac (disk cloning, time machine)
PRO - you get a lot of harddisks (internal, cheap and fast ones)
- it's almost stupid not to use a raid setup (such as 10)
- serious GPU power is affordable, but OSX is picky
- repairs are really really cheap
(This obviously excludes anyone who's really affected by the spill.)
http://www.longurlplease.com/ is quite nice.
Bookmarklet, FF extension, and a JSON API. I've used the API, and it was a pleasant experience.
Apparently has strong correlation with IQ. Makes me wake up instantly in the morning. Less tired. Better concentration.
Don't take more than ~400mg /day.
So just consume the filter streaming api with your chosen hashtag. You will get all the tweets, or at least some and a measure of how many you missed (limit notices).
For every new user in said stream, add the number of her followers.
It's so easy you could write the code in the length of this comment. Of course, if you want to avoid counting duplicate followers, you'd have to do an average of 1-2 additional calls per user.
yorufukurou does regex and is generally tolerable (OS X) http://sites.google.com/site/yorufukurou/home-en
Apart from that, it's easy to roll your own stuff - for example using the tweepy python library.
If you can "grasp" your data by looking at it, use excel. If your data is too much to look at, use R.
Excel lends itself more to shallow exploratory approaches, while with R, you have to think first (or rather: always).
Sadly, recovering from a fragmented SSD on OSX right now involves opening the machine and booting linux. (I tried that, and it works: http://forums.macrumors.com/showthread.php?t=841182)
Note, however, that files are decompressed on writes, so don't try it on anything large and frequently written to.