I read that the bandwidth is 50% lower on the M3 combined with a lower CPU core coun. This reduction will impact inferrence performance. It maybe better to stick with M2 series if you really really think spending $10k on a laptop mac to do inferrence slowly (but faster than a plain PC of course) make sense.