Helium atoms are actually smaller than hydrogen atoms, and much smaller than hydrogen mollecules.

While that is true, there are metals through which hydrogen can diffuse faster than helium, because the hydrogen molecules dissociate and ionize when entering the metal and the hydrogen ions diffuse through the metal individually.