RSA key sizes have gone up constantly over the years exactly because we did factor ever bigger numbers. ECC key sizes are the same as when the schemes were new, that's one reason ECC is better.