We can't because we are consuming 6-7 earths worth of other resources already. We are already in ecological overshoot. If it was only oil, you'd be right, but all planetary resources and pollution sinks are being consumed.

https://www.amazon.com/Limits-Growth-Donella-H-Meadows/dp/19...