The "calories in" part is more complicated than people like to admit too, and probably more important for weight loss. The way our body handles hunger and its relative primacy in our mental state makes it unnecessarily difficult to calorie restrict and then maintain, when eating certain diets. It's like telling an alcoholic "just stop drinking, duh" or an insomniac "just relax and sleep, simple as that". Just because something is in our brain doesn't mean we have full control over it, and I'm not sure why food is treated like something that everyone magically has complete self-control over, in contrast to _literally everything else_.
I'm really really fortunate to have grown up in a good food culture, and worked on it a little more in college. Meeting CICO goals and losing weight when I want to is really not that difficult for me, but I don't think this has much to do with self-control or my genetics. The way I eat just makes hunger less of a factor in my life: I rarely get hungry, skipping meals is never a problem, I get satiated quickly, etc etc.
I think of this as the "calories in" portion. There was never any reason to assume the means by which we measure the caloric content of food truly represented the caloric energy available to the body.
I'm not sure what chemically needs to happen, fat is transported from the bowel to the bloodstream in a relatively complex process, but once it's in the blood, it's in the same form as in storage, as triglycerides.
In fact, the triglyceride content of a person's fat stores will reflect their diet, which is a strong indication it comes directly from the food without processing: https://www.ncbi.nlm.nih.gov/pubmed/4072956
However, the "calories out" portion of that equation is actually quite complicated. In recent years many studies have indicated that the body does not process all calories in the same way. So "calories out" depends on a lot of things, including:
- metabolism, which can be increased by exercise and muscle mass
- what specific kind of "calories in" you're getting, and how your body processes these
- calories burned directly by exercise
To highlight one specific example of this, a calorie of fructose may be processed by the body very differently than a calorie of, say, vegetable fat: https://www.youtube.com/watch?v=dBnniua6-oM