There is conference call software that only allows a panel to talk. It's used to give remote presentations to a large group of people.

For example Webex has a product for that, as well as Bluejeans.