You mean the sponsored segments that creators encode into their videos? I believe I haven't seen any ads that came from Google as a Premium subscriber.

I guess YouTube could offer some way for creators to deliver two different videos to regular and premium subscribers so they could even take out sponsored segments?

Assuming this would be a non-trivial balance act because decently sized niche channels could probably make a big chunk from a big sponsor vs. free users seeing ads.