What exactly is tracked though? What information about my videos and my usage patterns are send to Google?

It would be great if you could use a self-hosted analytics platform instead! :)

And I would strongly advise not to develop based on anonymous analytics, users might tell you different desires if you ask them and use completely different workflows if added. Optimizing for web analytis metrics has ruined many projects.