It's certainly not the sole determinant of performance but given two reasonably solid designs, one with a vastly larger transistor budget and major node advantage to boot, I know which one I'd pick as likely winner.

Cache size is very related to performance.