The factors affecting program speed are numerous, and I would guess that types do not have nearly the greatest effect.

Most of us are not optimizing for program speed. Machine time is cheap. Human time is expensive. The biggest cost-savers for most programmers will be the ergonomics of a language, not the optimizations available to the compiler.