News for hackers. Stuff that matters.
Re:Video Vectorization by londons_explore on Monday July 20, 2020 @03:27AM (#23895512)
Is there market demand for this?

In a world where videos are still sent around as multi-megabyte gif files, and audio clips are still distributed with a random slideshow on YouTube, I think a lot of users aren't so bothered about efficiency - they just want the simplest thing that works.

Lots of music is most efficiently stored as MIDI, yet how many songs on iTunes are midi?

For video, raster is king because it works for everything.

Re:Video Vectorization by laserpistus on Monday July 20, 2020 @08:40AM (#23897148)
We (scrimba.com) actually do something similar for e-learning within programming. And it definitely makes sense for both students and as a business.

- Our videos use about 1/100 bandwidth of a video. This matters for rendering (fans running when watching HD?) and to people who live in places with shitty ISPs like in Germany

- It is rendered and thereby crisp as a Pringle

- No codec needed as we render it as html

- When you pause a video you actually have the text there, not pixels. For programming that allows you to copy and change things!

- We store the context it was recorded in (dev environment) so you can change and run code in the "video" itself. This changes the pedagogy you can do in a video to be more interactive and hands on.

Re:Video Vectorization by gokhan on Monday July 20, 2020 @06:03AM (#23896338)
Netflix and others would be interested in mega bandwidth gains for animated content. They usually own both ends of the stream so they can deploy whatever they want.
Re:Video Vectorization by black_puppydog on Monday July 20, 2020 @04:21AM (#23895811)
If you could drastically reduce the size of videos, self-hosting video distribution pages for e.g. training material would suddenly become feasible, if not for individuals then for small companies.
Re:Video Vectorization by laserpistus on Monday July 20, 2020 @09:40AM (#23897689)
Yep, we serve around 50.000 hours of video in a month with a similar format and have ~0 extra bandwidth fees.
Re:Video Vectorization by kevingadd on Monday July 20, 2020 @04:26AM (#23895845)
If you try to do it, you'll find that self-hosting for these scenarios is surprisingly cheap. You might be able to just use YouTube, anyway.
Re:Video Vectorization by black_puppydog on Monday July 20, 2020 @04:43AM (#23895943)
Well, youtube is exactly not self-hosted. For one reason or another, you might really not want to have to deal with youtube (or vimeo for that matter) and it would be great to have the possibility to opt out of using such a service.
Re:Video Vectorization by jpalomaki on Monday July 20, 2020 @04:57AM (#23896023)
In some parts of the world mobile data is expensive compared to income and this is likely limiting consumption of services like online video.

Random link with some pricing information for Africa [1] claims prices are up from $0.50/GB.

[1] https://kenyanwallstreet.com/mobile-data-pricing-2020-report...

Re:Video Vectorization by dimatura on Monday July 20, 2020 @06:23PM (#23902506)
It's not really the same. True, MIDI won't work for say, iTunes, because it doesn't capture a lot of the information needed to recreate the audio of your average song. But for certain types of video, you can capture everything you need to recreate it faithfully with a vector format, at much higher compression rates. I think a better analogy is SVG -- which is not as popular as raster formats in the web, but it certainly has its place.

(As an aside, MIDI is a useful format in its own right, and is still alive and well in the music-making world, even if from a technical perspective it's sort of outdated in 2020.)

Re:Video Vectorization by xanthine on Monday July 20, 2020 @03:32AM (#23895547)
They've listed some uses for it — animated videos, e-learning (the likes of Khan Academy). While I doubt that animation would shift to vector video any time soon, it indeed would help e-learning a lot, speaking from the side of the content distributors (less size). The only benefit for end users might be faster streaming, but yeah, I agree that the average user can't be bothered about it.
Re:Video Vectorization by egypturnash on Monday July 20, 2020 @12:55PM (#23899657)
Lots of animation is done in vector tools to start with. If this format goes anywhere it would probably be pretty easy to add exporters to Toon Boom, Animate, OpenToonz, and whatever else people are currently using - I left that industry a decade and a half ago so I'm not too up on what everyone's using right now.
Re:Video Vectorization by vhiremath4 on Monday July 20, 2020 @03:29AM (#23895525)
It's a good point. Internet speeds are also quickly increasing in areas getting online for the first time.
Re:Video Vectorization by kevingadd on Monday July 20, 2020 @04:20AM (#23895794)
IMO the biggest problem is that even for enterprise/large-scale-website scenarios, the combination of the product cost, the cost of downloading the decoder on each machine, and the increased cpu/gpu load (resulting in lower battery life) can drown out any advantage from the size reduction. The fact that it only works for a subset of video content is another problem.

Switching to H265 or AV1 is way more compelling in practice because it works for everything, it's hardware accelerated, the decoders are off-the-shelf, and the quality is significantly improved. A modern GPU can both encode and decode H265.

Re:Video Vectorization by xanthine on Monday July 20, 2020 @03:45AM (#23895616)
>Lots of music is most efficiently stored as MIDI, yet how many songs on iTunes are midi?

While storing music as its component instruments is indeed size efficient, converting existing music into MIDIs using some ML/AI algorithm is not yet effective. Vectorly seems to convert _existing_ raster videos into vector ones using some combination of computer vision algorithms.

Re:Video Vectorization by rjmunro on Monday July 20, 2020 @06:43AM (#23896517)
Playback of a MIDI file also doesn't return the original sound quality, it plays the same notes with generic sampled instruments. For high quality samples of some instruments, this can be OK, but for others, it sounds terrible. As for lyrics, you have to use a speech synth... https://www.youtube.com/watch?v=bJjxy4V00r0