Nope, you can do it with $500k in a Colorado suburb for example. This guy is a living example of it, with multiple kids, multiple cars, a house, furniture, etc:

http://www.mrmoneymustache.com/