Because the cap is arbitary. It says that no matter what kind of person someone is and whether they are a partner or relative of someone who is already a national or legal resident, they are not allowed residence.

It gets even worse if you apply an immigration cap to refugees and asylum seekers as well, at which point you're saying that the arbitary immigration cap is potentially more important than their survival.