They don’t have a “record of your activity.” They only know that you have signed in with Apple on a site. They aren’t tracking your behavior or usage. The Apple JS doesn’t have to be on any page except the sign up/in.