Mars has lots of water ice, which is made (almost) exclusively of - you guessed it - hydrogen and oxygen.

So yes, both of those things are plentiful on Mars. Maybe not to Earth standards (or the standards of, say, Ceres or Enceladus), but certainly abundant compared to our own moon (at least as far as current information tells us).