The carbon footprint of mining and refining oil for gasoline certainly dwarfs that of lithium mining. Partially because there are a lot more ICE cars than EVs now, but also because gasoline is needed repeatedly over the lifetime of the car, while lithium is mined only once per car.