Because only a small % of all people in tech are good speakers. Having a smaller population to choose from would mean a higher risk of putting a bad speaker on the lineup.

You're assuming that a) good-speakerness is a fixed quality, and b) that the speaker selection process is something like pulling bingo numbers. Neither is true.