I suspect it is a factor of both relatively slow velocities, relatively low payload capacity, and substantial dependence on the weather (particularly with regard to takeoff and landing).

Fuel costs are but one consideration, and the same reasons we don't transport much cargo by sail are probably applicable.