Lithium is mostly made the same way as salt - just like you said. There are a few pit mines, but we also do that for .... everything else. Including oil!
All mining is bad for the environment to an extent. The total environmental impact of EVs appears to be substantially less than ICE vehicles, all things included.
I think it will take a combination of things. I think the geopolitical controls over Lithium supply are probably more concerning, as is the availability of resources in and of themselves, which won't meet demand and will drive up costs.
I'm also concerned about the sheer number of products being shipped in small batches everywhere all day, at least in the US... I see an Amazon/UPS/USPS driver on my small street alone many times a day. It just feels very inefficient and wonder if this is just worse than taking a couple steps back away from convenience.