You could use this exact argument form to argue that there are limits to your “right to life” as well.

After all, there are laws that have existed to limit that right for hundreds of years. The death penalty.

My point is that just because there have been laws in the past, that changes nothing about if something should be a right or not.