You are right that ordinary people were not defrauded directly, but pension funds are basically ordinary people's money. There just happened to be a middleman (the pension fund admin.)

Plenty of pension funds lost plenty of money