It was never decided by a single person. We always did a 5-15m debrief, consisting of about 4 people (hiring manager, 2 interviewers, hr to facilitate and maybe a shadow 2), between interviews on the day.