With the size of modern chips the instruction set has very little to do with an overall chip design. Most of it is a balancing act between power, performance and area for things like caches, controllers, optimizations, accelerators and so on. Then there are also factors like verification complexity and the fab technology you are choosing.