It's more than instruction decoding, though admittedly that's a big part. There's also memory ordering (tho it's debatable whether that's problematic), the number of logical registers (particularly important for JITs) and messy dependencies like partial flag updates.