I read a conspiracy post about how the kids' voices were AI (clearly not) but the post also pointed out many examples of audio clips being recycled across episodes. I notice it while watching now, so I think you're on to something here.

Conversely other shows have had many different voices actors without noticeable detriment by their targets audiences, such as Peppa Pig, discussed elsewhere here.