“Oil” is 10-15% less dense than water. So yes, “about” the density of water, for napkin purposes. This would be diesel or heating oil.

Gasoline is 30% less dense than water though.