I would also consider buying Berkshire Hathaway stock. Expensive, B-series at about 4K, but worth it, again, long term. Slightly better returns too.
Even better, do not listen to me (IANA financier), but read Phill Greenspan's excellent investing advice [2].
[1] https://personal.vanguard.com/us/FundsIndexOnly [2] http://philip.greenspun.com/materialism/money
But for a really thorough discussion of those details check Investments by Bodie, Kane and Marcus (http://www.amazon.com/Investments-Zvi-Bodie/dp/007293414X/re...). My corporate finance prof encouraged me to look into it, then it was required reading for an economics course I took later. I understand it's the standard-bearer in most finance departments, so there's no going wrong if you're willing to work through the technical parts.
ETFs sometimes get a bad rap because there are so many slice-and-dice funds - gold mining ETFs, Alabama mid-size business ETFs, etc. Stick with the basics (stocks and bonds, US and international, developed and emerging, large cap and small cap).
As for specific advice, investing isn't that difficult. The best approach is to be lazy: decide on an asset allocation (e.g. 50% US stocks, 30% international stocks, 20% bonds), buy index funds, and rebalance to these percentages every now and then. Vanguard (https://personal.vanguard.com/us/home) is probably the most respected provider of index funds; give them a shot.
Check out David Swensen's lazy portfolio if you want something more advanced: http://www.npr.org/templates/story/story.php?storyId=6203264.
For investing discussion, try http://www.bogleheads.org/.