It's either an exaggeration, or his mind works in some very special ways.

You don't need to memorize multiplication table to be good at math, but this is an equivalent of saying "I wouldn't even be able to add two numbers together in my head!".