You could eat nothing but 1000 calories of pure sugar a day and still lose weight
Yes, if you were locked in a room and passed exactly 1000 calories of sugar cubes and water every single day. Most of us live in the real world with food all around us, easily available, and responsibilities to stay on top of. It's really easy to say "this diet is making me feel terrible, I'm just going to eat what I want so I won't be so cranky to my kids".
http://www.cnn.com/2010/HEALTH/11/08/twinkie.diet.professor/
Calorie restriction diets feel like holding your breath for 6 months straight. Then as soon as you can't take it anymore, you exhale and instantly gain it all back. It's horrible. Nobody's will can hold out for that long.
Some people are happy eating whatever diet keeps them at an ideal weight. Some people never will be, and it's a form of torture.
The quality of your calories absolutely matters.