So at the time of the formation of the solar system, the whole area was a big gaseous cloud of supernova debris with lots of ice. The ignition of the sun started the frost line, and pushed volatiles out of the inner solar system. However some had already been trapped in the formation of the planets, and rose to the surface as they cooled. That's where Earth's ocean came from, and we know Mars and Venus had oceans too. Presumably also Mercury, although I'm sure that was short-lived.
So yes, it's all from cometary material. But then ALL of the Earth is from cometary material, and the oceans only make up a small amount of the Earth's total mass.
We’re not sure from where Earth’s water came [1]. Some evidence suggests the Earth was born with all its water, some that most came from comets.
[1] https://en.m.wikipedia.org/wiki/Origin_of_water_on_Earth
The water on Earth may seem to be a lot to us on the surface but it is only about 0.02% by mass [1].
https://www.universetoday.com/65588/what-percent-of-earth-is...
Also, we seem to have a lot of water. It's really all from comets, a little here, a little there?