Helium is comparatively expensive, but you don't expend it as part of normal flight and it doesn't migrate very quickly through modern materials. A bigger problem than loss is fouling - you have to pump out the helium and purify it every so often (I think Zeppelin does it every six months).
Expensive OR very cheap and explodey. (Gasoline is also explodey)