My undergraduate degree was physics, but we spent time in other classes run by the maths and engineering departments.
The stats for UCL are here: https://www.ucl.ac.uk/srs/statistics/tables/g/1415
It's difficult to get more granular data. The graduate figures there are for masters and PhD combined. My department is space and climate and we certainly don't have 99 PhD students!
I can't find stats for my undergraduate intake (Warwick '08), so you'll have to take my word for it. Things may have improved a lot since then. My girlfriend says that her physics course (St Andrews) was fairly even.
Oxford is an interesting edge case because they seem to control for gender quite well. They accepted more girls than boys for undergrad in 2013 (over all sciences) at least.
https://www.ox.ac.uk/gazette/statisticalinformation/#d.en.62...
It was talking about science-degree courses, not Physics specifically. You seem quite sure it's not true, do you have any sources?