As a user of both Imperial and Standard International units, I agree with you.

As a kid, one of my science educators spoke about the many benefits people gain from becoming familiar with basic units. I bought in and did so during the big metric push that happened around that time.

I ended up more familiar with Imperial units.

Then, later in life, I entered a young industry, with strong users of metric, Standard International units.

So I did the work to build familiarity just as I did long ago. Took half a year and today I enjoy the benefits.

And those are:

Ease of understanding unit values meaning in my daily life.

Ease of expression of same to others.

Greater accuracy estimating.

Easier computation and unit checks.

And so on...