I'm not sure you understand the difference between a depreciating asset and an appreciating asset. With very few exceptions, a car is a depreciating asset. It's worth less tomorrow than it is today. A house (with few exceptions) is not a depreciating asset. With the singular exception of 2007-2010, home prices tend to rise.
Also, I'm sorry to say, unless your definition of "conservative instement" includes a money printing machine, no conservative investment vehicle since the end of 2008 has broken even 3%, and 5% since 2007 let alone 6%.
In any case, "home prices tend to rise" doesn't make sense if you're trying to justify buying one as an investment. Borrow ten times your net worth and buy a house hoping it'll appreciate. Not exactly a brilliant investment scheme.
Also, you could argue that a house is a depreciating asset. Shit breaks and you have to maintain it. If you were a business you'd actually have to account for depreciation on buildings.
Basically the only thing that will appreciate when owning a house is the land it sits on. A really nice house in a crappy area is going to lose value until the demand for the location starts going up again.
In the words of Shaun Micallef: "All cats are brown, as this exception to the rule proves".
http://www.infochoice.com.au/banking/savings-account/term-de...
If you compare 5-year term deposits most are in the 6.8% - 7.1% range.
Now...if you have something over $100,000 USD burning a hole in your pocket that you won't need to touch for a while, you can purchase something called a jumbo CD, and the 5-year instruments will just break 2.3%.
Take all of the extra principle payments you have made - calculate what they would have made at a 5, 6, or 7% interest rate. Then, look at your home equity, subtract the amounts you have paid in repairs and taxes, and ask yourself which number is larger. Chances are you have been foolish with your money.