If you are watching video constantly, then this is a concern. If your phone is mostly sitting in your pocket waiting for the GSM signal to wake it up, then it's irrelevant.
(And, I have a portable device that plays arbitrary video formats just fine on a rather-big 5" screen for a whole transatlantic flight; 7-8 hours. So the current technology is more than adequate, H.264 or not.)
So personally if it's a difference of battery life, I'd choose the one that uses less power and gives me more time.