I'm not a chip designer or anything like that, but I think it isn't the difficulty of creating processors with so many cores (or arrays of processors equivalent) that has stopped us, but the cost benefit of increasing cores to the expense. I use an HPC cluster at work, but for what I'm doing it makes sense to use the hundreds of cores available. Indeed, most of it is embarrassingly parallel.