Not all your online activity, even if they kept logs it would be something like 'this site asked for age verification, we said yes'.
So they would have a list of sites, if they stored them and were allowed to store them. Which is something they can get from your ISP regardless.
It could be used for bad sure, lots of things can. In my perfect world this wouldn't exist at all like it hasn't for 30+ years. But putting the burden on private companies was always going to create other avenues for issues.
The fact that the powers-that-be need to understand but choose not to is that what they want is literally impossible, even with mandatory government blood screenings to access computers. Anything short of requiring identification per POST is inadequate. This whole thing is a fools' errand and we must not give any ground.
Honestly I'd rather have private companies figure it out. Then at least you'll get multiple options, including from privacy-first companies. But that still sucks, and my preference strongly goes towards OS-level Age Indication. Just as effective in practice, 100% private and offline.