The real cost of fuel absolutely goes up and down. It has bounced back and forth between $2 and $6 of today's money for the past century.

If you're looking only at nominal figures, then what you're seeing is the inflation of the dollar, not the change in how much gasoline costs.