Science isn't the memorization of facts. To graduate from Harvard, you must actually understand how to do science at a high level. Many of those skills transfer between subjects. Having a physics degree might not make you a great biologist, but it's also not nothing.