Most of the time that there is someone speaking on the House or Senate floor, there are only a handful of other representatives around, milling about, waiting for their turn to speak, or doing something else. The only times the chambers are ever full are during votes or public events. Not only are most of them not paying attention, they aren't even in the room most of the time Congress is in session.