Those are all general thoughts and results would be different for different problems. Some can be parallelized for millions of people, some can not be at all. Parallelization is as much about throughput as latency. Nine women can not gestate a child in one month, one can apparently gestate eight in nine months.