As said in others answers, there will be multiple annotations sources so each one will have it's own moderation to do and users will have the choice to subscribe to any or all of them.

Therefore the moderation will not have anything to do with the content owner. It's comparable to reddit or HN : would you complain that content owner have no control over discussion about their content on those sites ?