News for hackers. Stuff that matters.
Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:02AM (#23747923)
The dirty secret of video codecs is that you can't make a modern video codec that isn't patent encumbered, which in turn makes it so that even if they wanted to be open, they go for defensive patents, which in turn perpetuate the situation.

At least the patent licenses usually used with MPEG mean that private use of open source implementations is free.

Re:H.266/Versatile Video Coding (VVC) by cyphar on Monday July 06, 2020 @10:12AM (#23748038)
> The dirty secret of video codecs is that you can't make a modern video codec that isn't patent encumbered

The existence of Theora, VP8, VP9, and now AV1 seems to contradict that theory.

You could argue that they infringe on some unknown patents, but that is also arguably true of patent cabals like MPEG (you just hope that the cabal is big enough that there aren't any patentholders lurking outside). The only difference is that with a patent cabal you have the fun of having to obey the restrictions of everyone who showed up with a possibly-related-in-some-way patent and joined the cabal.

Not to mention that it isn't necessary for a patent pool to be a cabal. AOMedia has a similar structure to a patent cabal except it doesn't act like a cabal (its patent pool is royalty-free in the style of the W3C). So even if the argument is that a patent pool is a good idea (and video codecs cannot be developed without them), there isn't a justification behind turning the patent pool into a cabal.

> At least the patent licenses usually used with MPEG mean that private use of open source implementations is free.

You say that, but there's a reason why some distributions (openSUSE for one) still can't ship x264 (even though the code itself is free software). Not to mention the need for Cisco's OpenH264 in Firefox (which you cannot recompile or modify otherwise you lose the patent rights to use it). The existence of the MPEG patent cabal isn't a good thing, and any minor concessions you get from them do not justify their actions.

Re:H.266/Versatile Video Coding (VVC) by ChrisMarshallNY on Monday July 06, 2020 @10:41AM (#23748391)
Yeah. It's a mess.

The video patents aren't just "patent troll" patents, either. They are highly enforceable, and were registered by corporations like Ampex.

I have been trying to write a simple app to stream RTSP (security cameras), and that has been a pain.

I need to basically use either proprietary (paid) or GPL software to do it.

Video software is not for the faint of heart. Much as I grouse about the licensing, I am not about to develop my own codec.

I did write this one app, which is an ffmpeg wrapper, to convert RTSP to HLS (Which is not -currently- suitable for realtime streaming): https://github.com/RiftValleySoftware/RVS_MediaServer

It's GPL, because I need to use the GPL ffmpeg H.264 codec.

Re:H.266/Versatile Video Coding (VVC) by iso1631 on Monday July 06, 2020 @12:41PM (#23749665)
> I need to basically use either proprietary (paid) or GPL software to do it.

> It's GPL, because I need to use the GPL ffmpeg H.264 codec.

I don't understand the problem?

I can see the problem with people patenting things and preventing you from writing your own implementation, but it seems you just want other people to do the hard work of implementing it so you can wrap a skin around it and do what?

Re:H.266/Versatile Video Coding (VVC) by ChrisMarshallNY on Monday July 06, 2020 @12:47PM (#23749735)
I wasn't complaining. My apologies for coming across that way.

It was a statement of fact.

I've been writing open-source software for well over 20 years (actually, well over 30 years –Where does the time go?).

I think I understand the issues involved.

Re:H.266/Versatile Video Coding (VVC) by striking on Monday July 06, 2020 @10:48AM (#23748482)
You can license x264 to not have to worry about the GPL. Though that costs money and you may find yourself signing MPEG LA contracts.

edit: Your project reminds me, https://github.com/arut/nginx-rtmp-module is super worth checking out and might be helpful to you.

Re:H.266/Versatile Video Coding (VVC) by ChrisMarshallNY on Monday July 06, 2020 @10:53AM (#23748539)
Yeah, but it was a free app.

One of the frustrating things about implementing video software, even licensing it, is pretty much everything out there is an expression of ffmpeg, which is a really, really good system, but does have some baggage.

Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:26AM (#23748226)
As others mentioned, VP8, VP9 and AV1 all are patent encumbered - they just happen to have licenses that are royalty-free and as someone mentioned, include retaliation clauses which help fighting off submarine patents - but that's essentially a possibly high-stakes game of chicken.
Re:H.266/Versatile Video Coding (VVC) by cyphar on Monday July 06, 2020 @10:33AM (#23748297)
While they are patent-encumbered in the strictest sense of the word, they are not as aggressively licensed as H.266 -- which is what GP was lamenting. Licensing H.266 under the GPL(v3) wouldn't erase the existence of the patents and it would still be "patent-encumbered" in the same sense that VP8/9 and AV1 are.

And retaliation clauses are present in basically every free software license that has clauses dealing with patents (including Apache-2.0).

Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:39AM (#23748365)
A big part is in how expensive can you make said retaliation.

I'm more and more fond of calling it all a big game of chicken, a MAD without nukes,

Re:H.266/Versatile Video Coding (VVC) by craftinator on Monday July 06, 2020 @12:24PM (#23749495)
Hah I love this analogy! Guess that's societal progress for you; we use currency to replace munitions.
Re:H.266/Versatile Video Coding (VVC) by RBURBURXEIVG3KO on Monday July 06, 2020 @11:15AM (#23748789)
Wouldn't Apache 2 be a better license for this since it is explicit on patents?
Re:H.266/Versatile Video Coding (VVC) by cyphar on Monday July 06, 2020 @11:19AM (#23748842)
GPL is the example GP used, which is why I referenced it. It's not really important what free software license it would be (though GPLv3 does have an entire section (s11) which is all about patents -- that's why it's compatible with Apache-2.0).
Re:H.266/Versatile Video Coding (VVC) by mtgx on Monday July 06, 2020 @11:28AM (#23748932)
> but that is also arguably true of patent cabals like MPEG (you just hope that the cabal is big enough that there aren't any patentholders lurking outside)

Apparently, they aren't. There are at least 2 other patent pools that claim patents for HEVC, and I think I saw 3 in some other article before:

https://streaminglearningcenter.com/codecs/hevc-ip-mess-wors...

Re:H.266/Versatile Video Coding (VVC) by speedgoose on Monday July 06, 2020 @10:19AM (#23748141)
Software patents aren't a thing in ~~Europe~~ a few European countries. Sure it's difficult to ignore the American market for a company, but an independent developer could specify a state of the art video codec without thinking about patents.

Edited because I didn't know that some European countries accept software patents.

Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:24AM (#23748205)
Software patents are a very complex thing.

For example, many countries in EU do not allow patents on software, but that's not something you can claim to be true for all of them - at least before Brexit, since iirc UK was pretty happy to provide software patents.

Then there's a case where if you're really willing you can, as far as I understand, force a patent dispute through WTO, with possibility of patent valid in USA being executed for example in Poland, despite the fact that the patent is invalid in Poland (it doesn't matter if your software is part of physical solution in Poland, algorithms of any kind are not patentable).

Re:H.266/Versatile Video Coding (VVC) by rwmj on Monday July 06, 2020 @10:38AM (#23748345)
What really annoys me is that Article 52 of the EPC explicitly excludes software from patentability. It couldn't be more clear in its language (to me). But when I talked to a patent lawyer about this a while back he said didn't really mean that and software could and is easily patented.

https://en.wikipedia.org/wiki/Software_patents_under_the_Eur...

Re:H.266/Versatile Video Coding (VVC) by speedgoose on Monday July 06, 2020 @10:30AM (#23748262)
One more benefit of the brexit for mainland Europe! I didn't know about using the WTO to dispute invalide patents. I guess a WTO dispute can make sense for a Boeing software patent used by Airbus. I wonder whether the WTO would care about an independent developer. It's not very good press, but perhaps it's fine for them.
Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:33AM (#23748288)
WTO doesn't care, WTO serves as a forum to get it through.

The question is, does a "practicing entity" holding the patent cares enough to go through the hardest route to get the patent executed using WTO as a forum? One needs to compare costs and benefits. It's why patent trolling involved pretty much few counties in Texas, because that's where the costs were lowest compared to benefits.

Re:H.266/Versatile Video Coding (VVC) by makomk on Monday July 06, 2020 @12:53PM (#23749791)
It's not just the UK that allows software patents in practice - as the discussion hints at, Germany does too, and if I remember rightly pretty much the last patent affecting MP3 was a German patent on zero-padding held by Philips, who enforced it aggressively against manufacturers of devices like music players.
Re:H.266/Versatile Video Coding (VVC) by jcranmer on Monday July 06, 2020 @11:31AM (#23748959)
> Software patents aren't a thing in ~~Europe~~ a few European countries.

Look at all those European patents in the MPEG-LA license pool!

https://www.mpegla.com/wp-content/uploads/avc-att1.pdf

Re:H.266/Versatile Video Coding (VVC) by vertex-four on Monday July 06, 2020 @11:38AM (#23749034)
Software patents can exist, but are almost always unenforceable, is my understanding of it from researching this for my own media-related project.
Re:H.266/Versatile Video Coding (VVC) by Ace17 on Monday July 06, 2020 @02:18PM (#23750952)
> Software patents can exist, but are almost always unenforceable

Wanna take the risk? You might end-up winning the lawsuit, but at this moment, there's a good chance for you to be already out-of-business.

Re:H.266/Versatile Video Coding (VVC) by vertex-four on Monday July 06, 2020 @04:22PM (#23752306)
As I understand it there has been no successful enforcement of a software patent so far, and it's ridiculously unlikely that I (as opposed to any other actor in this space) will be the first case. So yeah, I'll take that risk.
Re:H.266/Versatile Video Coding (VVC) by Ace17 on Tuesday July 07, 2020 @02:28AM (#23756316)
I would love that you be right. However, here are examples of successfully enforced software patents:

- in Europe: http://www.bailii.org/ew/cases/EWCA/Civ/2002/1702.html

- in US: https://web.archive.org/web/20061205050434/http://eolas.com/...

But as I said, if your startup is being sued by Dolby, whether the enforcement is successful or not is actually irrelevant. Showing that your work doesn't infringe a patent, or that Dolby's patent is invalid, is a money and time-consuming process (unsurprisingly, patents are not generally written to facilitate re-implementation or defense).

(Moreover, in the US, in some cases, the patent owner might even get a preliminary injunction ( https://www.tms.org/pubs/journals/jom/matters/matters-9712.h... ), which might seriously and immediately harm your business. I don't know if such a thing exists in Europe).

Big tech companies like Dolby and IBM use a preventive racket-looking technique ; it involves trying to sell to potential infringers a "protective" subscription, but there's no preliminary analysis of whether there actually is any patent being infringed.

During broadcasting tech events like IBC or NAB, Dolby actually sends people to other company's booths for this ; and there's a famous story about IBM against small-at-this-time SUN : https://www.forbes.com/asap/2002/0624/044.html , whose gist is:

> "OK," [the IBM lawyer] said, "maybe you don't infringe these seven patents. But we have 10,000 U.S. patents.

> Do you really want us to go back to Armonk [IBM headquarters in New York] and find seven patents you do infringe?

> Or do you want to make this easy and just pay us $20 million?"

Re:H.266/Versatile Video Coding (VVC) by vertex-four on Tuesday July 07, 2020 @05:48AM (#23757379)
I meant in Europe, and that case is not successful enforcement of a software patent (merely a preliminary question as to whether some jurisdiction weirdness could be a reason that William Hill did not infringe on a patent); in fact there was no question to the court as to whether the patent was valid, and the case ended with an answer to the question asked.

This is a quirk of some UK courts, where you can literally just start a case to ask a question on some detail of the law and get an answer.

The question was:

> "Is it a defence to the claim under s.60(2) of the Patents Act 1977, if otherwise good, that the host computer claimed in the patent in suit is not present in the UK, but is connected to the rest of the apparatus claimed in the patent."

From Wikipedia:

> Questions of validity were never considered by the court.

Re:H.266/Versatile Video Coding (VVC) by josaka on Monday July 06, 2020 @10:29AM (#23748257)
I think Europe does allow software patents of a sort: See https://www.epo.org/law-practice/legal-texts/html/guidelines... Or you might have a particular definition of the term in mind that excludes these, but I think when most folks here the term, they'd include what the EPO permits.
Re:H.266/Versatile Video Coding (VVC) by speedgoose on Monday July 06, 2020 @10:33AM (#23748295)
The European patent office is not an official thing. It's an independent private organization that will gladly take your money to submit patents.
Re:H.266/Versatile Video Coding (VVC) by AdrianB1 on Monday July 06, 2020 @12:30PM (#23749546)
The European Patent Organisation is an intergovernmental organisation (https://www.epo.org/about-us/foundation.html).

Not a private organization.

Re:H.266/Versatile Video Coding (VVC) by speedgoose on Monday July 06, 2020 @01:04PM (#23749908)
Alright, I was wrong. Still strange that they issue patents that are obviously invalid.
Re:H.266/Versatile Video Coding (VVC) by AdrianB1 on Monday July 06, 2020 @05:31PM (#23753009)
I know quite well a patent examiner there; there is a lot of politics and incompetence in appointing people and a lot of pressure to accept most of the patents they receive, if I understood correctly part of the reason is politics (if you refuse, even stupid patents, influential people will get upset) and part is the idea to have as many patents as possible as a measure of European creativity and innovation and ... bla-bla. Universities and research institutes are measured by the number of patents and if they don't invent something good, they will patent something stupid just to get the numbers right.
Re:H.266/Versatile Video Coding (VVC) by vertex-four on Monday July 06, 2020 @02:04PM (#23750776)
The reasoning is that individual states have Opinions about the validity of software patents and they're going to keep issuing them until somebody with the proper authority clarifies that the law means what the law says, although as far as I can tell none have actually been successfully enforced.
Re:H.266/Versatile Video Coding (VVC) by Ace17 on Monday July 06, 2020 @02:15PM (#23750915)
In practice, EU does allow software patents. The software invention just needs to be disguised as a machine. Industrial property lawyers know very well how to do that, and it's unfortunately very common.

> Edited because I didn't know that some European countries accept software patents.

European patents are granted at the European Patent Office (individual european countries also have their own patent offices, whose patents can only be enforced in their home country).

Re:H.266/Versatile Video Coding (VVC) by p_l on Wednesday July 08, 2020 @07:50AM (#23768963)
enforceability of EPO patents varies, that's why there was a big fight on software patents in EU parliament not so long ago, not sure however on current status - that needs to be checked I guess.
Re:H.266/Versatile Video Coding (VVC) by auscompgeek on Monday July 06, 2020 @10:13AM (#23748056)
Are AV1 and VP9 not modern video codecs? Or are you suggesting the patent claims have substance?
Re:H.266/Versatile Video Coding (VVC) by asdfasgasdgasdg on Monday July 06, 2020 @10:23AM (#23748196)
AV1 and VP9 are covered by plenty of patents. One of the differences here is that there is a retaliation clause in the licenses for AV1 and VP9. https://aomedia.org/license/patent-license/

"1.3. Defensive Termination. If any Licensee, its Affiliates, or its agents initiates patent litigation or files, maintains, or voluntarily participates in a lawsuit against another entity or any person asserting that any Implementation infringes Necessary Claims, any patent licenses granted under this License directly to the Licensee are immediately terminated as of the date of the initiation of action unless 1) that suit was in response to a corresponding suit regarding an Implementation first brought against an initiating entity, or 2) that suit was brought to enforce the terms of this License (including intervention in a third-party action by a Licensee)."

This makes it much harder for practicing entities or their licensees to assert claims against other practicing entities over the formats.

Re:H.266/Versatile Video Coding (VVC) by muizelaar on Monday July 06, 2020 @10:22AM (#23748189)
There are patents that cover AV1 and VP9 they just are just licensed without royalties: https://aomedia.googlesource.com/aom/+/refs/heads/master/PAT...
Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:21AM (#23748176)
They are modern video codecs which are playing chicken with possible submarine patents.

Ultimately, it's a question of how much you're gonna risk to get where you want, and how much power/influence/wealth you can bring to squash a possible lawsuit.

Re:H.266/Versatile Video Coding (VVC) by pavon on Monday July 06, 2020 @12:32PM (#23749570)
But H.265 and H.266 have the same risk - worse actually, as multiple submarine patents claims have risen again H.265, and there are now multiple licensing organizations that all claim they need to be paid if you want to use H.265, and over a decade later their claims still haven't been legally settled.

To completely avoid risk your only choice is to to use old technology where all the patents have expired (20 years in US), like MPEG-2. The next lowest risk is to use H.264 and VP9 which have been out for a while and whose the patent pools have stabilized over the years (and the original parts of the standard will have their patents expire soon - but not some of the newer profiles). After that I would argue that AV1 is less risky that H.265 and H.266, as a lot of work was put into intentionally avoiding patented technology that was not part of the pool, and no one outside the pool has yet made patent claims against it.

Re:H.266/Versatile Video Coding (VVC) by ksec on Monday July 06, 2020 @06:00PM (#23753286)
>To completely avoid risk your only choice is to to use old technology where all the patents have expired

EVC baseline is basically that, only using technology based on H.264 that are already expired or soon to be expired and patented techniques from companies that are giving it away to the standard.

In some way EVC is even more exciting than VVC.

Re:H.266/Versatile Video Coding (VVC) by nullc on Monday July 06, 2020 @11:14AM (#23748779)
> The dirty secret of video codecs is that you can't

You can, but fraunhofer certainly isn't trying!

> At least the patent licenses usually used with MPEG mean that private use of open source implementations is free.

0_o that is not at all the truth.

Re:H.266/Versatile Video Coding (VVC) by 1_player on Monday July 06, 2020 @10:06AM (#23747963)
> The dirty secret of video codecs is that you can't make a modern video codec that isn't patent encumbered

Why is that?

Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:18AM (#23748118)
Pretty much every method involved in high-efficiency video compression has a patent on it, doesn't matter how small part is involved.

Now compound this by the fact that a) trying to make an exhaustive patent search to get a verifiable claim that you don't infringe on any patent is very problematic b) known patent pools like MPEG-LA are known not to cover everything.

So you can make a reasonable bet that you avoid infringing patents by avoiding patents from MPEG-LA and few other better known groups, but you can't actually guarantee that you're not infringing on any patents.

This resolves, sort of, into a game of chicken and depends heavily on whether a lesser known patent holder decides it's worth it to bother executing against you... but even if they don't, unless they come out with a royalty-free license, the possibility of patent is a Damocles' Sword hanging over your codec.

Re:H.266/Versatile Video Coding (VVC) by jariel on Monday July 06, 2020 @11:33AM (#23748982)
"make an exhaustive patent search to get a verifiable claim that you don't infringe on any patent"

Is there even such a thing?

Isn't the problem that one has to actually go to court to get the answer to this question?

Re:H.266/Versatile Video Coding (VVC) by dfox on Monday July 06, 2020 @02:16PM (#23750928)
In theory you can do such kind of search. Problem is that doing that is impractically expensive (and at least in some jurisdictions doing that can actually raise your liability in case of patent infringement).
Re:H.266/Versatile Video Coding (VVC) by jariel on Monday July 06, 2020 @02:53PM (#23751371)
Does such a search indemnify one of liability though, is the big question?
Re:H.266/Versatile Video Coding (VVC) by p_l on Wednesday July 08, 2020 @07:50AM (#23768967)
No.

In fact, I heard more than once that current advice is to explicitly avoid searching :/

Re:H.266/Versatile Video Coding (VVC) by vertex-four on Monday July 06, 2020 @10:18AM (#23748125)
Because there are companies with a lot of money in this space which spend all their time trying new things and patenting anything they come up with, even if it doesn't make it into a published codec, basically.

The way to get around this is to exist in the EU and avoid providing anything to the US.

Re:H.266/Versatile Video Coding (VVC) by jandrese on Monday July 06, 2020 @10:18AM (#23748128)
The field is littered with companies holding submarine patents just waiting for that big payday when something using some tiny part that they patented gets popular and deployed to millions of devices so they can surprise everybody with their pricey licensing terms and huge lawsuit.
Re:H.266/Versatile Video Coding (VVC) by mekster on Monday July 06, 2020 @10:17AM (#23748110)
It would be hard to build a new algorithm without stepping on other established algorithms that are patented.
Re:H.266/Versatile Video Coding (VVC) by MikusR on Monday July 06, 2020 @10:09AM (#23748003)
That's what AV1 is.
Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:14AM (#23748058)
The situation with AV1 is "we are in middle of minefield and nobody got mine-clearing gear".

They can be reasonably sure they do not infringe known patents from certain Patent Pools and patents declared as part of MPEG-LA bundles. They can't provide reasonable data that they do not infringe on any submarine patent, something that killed 3 attempts by MPEG-LA to provide a royalty-free codec for the web - all that was required to kill it was a note from a company that they "might" have patents covering things they tried to release, or that they decided not to allow royalty-free license for their known patent.

Meanwhile patent search is complex enough that it's unreasonable to impossible to make a statement that you definitely don't infringe any unless you keep clear of anything invented within last ~20 years.

Re:H.266/Versatile Video Coding (VVC) by clouddrover on Monday July 06, 2020 @10:32AM (#23748277)
> The situation with AV1 is "we are in middle of minefield and nobody got mine-clearing gear".

That's true of every new video codec. It didn't stop the use of H.264 or VP9 or even HEVC.

Multiple companies have now rolled out AV1 into production. We'll see what happens.

Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:37AM (#23748336)
When I wrote that I didn't know about retaliation clauses in AV1 patent pool license. That said, a huge chunk of patents involved in all MPEG standards (AVC, HEVC, etc.) meant that if you tried to go after them, you might have lost licenses necessary elsewhere, so it's all a question of risk analysis for someone who wants to torpedo AV1 with a patent.

What's wrong is claiming that AV1, VP9, VP8 are "patent-free". They are not.

Re:H.266/Versatile Video Coding (VVC) by selectodude on Monday July 06, 2020 @10:13AM (#23748041)
Re:H.266/Versatile Video Coding (VVC) by clouddrover on Monday July 06, 2020 @10:16AM (#23748096)
I think that's more a case of Sisvel trying their luck.

I don't think they'll be successful. The Alliance for Open Media was careful to avoid potential patent problems during AV1 development. So, unless AOMedia seriously failed in that effort, AV1 will be alright.

Re:H.266/Versatile Video Coding (VVC) by p_l on Monday July 06, 2020 @10:20AM (#23748150)
Being careful and being successful are two different things, especially given how hard it is to do an exhaustive search over patents to ensure that no, no claim in any patent filing touches your code, especially given that there are regimes where patent filings for software get pretty much a rubber stamp and are based around "first to file" even if there's prior art.
Re:H.266/Versatile Video Coding (VVC) by ihuman on Monday July 06, 2020 @10:17AM (#23748105)
I'm confused. How is Sisvel able to sell a license for AV1 patents when they're not a member of AOMedia? Do they actually have AV1 patents, or are they trying to trick companies that would rather pay up than risk violating patents?
Re:H.266/Versatile Video Coding (VVC) by vertex-four on Monday July 06, 2020 @10:26AM (#23748230)
Basically, unlike copyright, you don't even have to know that someone else patented something in order to infringe on a patent and have them come out of the woodwork later. It's just even more expensive if you do know.

The patent system was not designed to have every tiny little technique patented, and this is its failure mode.

Re:H.266/Versatile Video Coding (VVC) by anticensor on Monday July 06, 2020 @10:54AM (#23748554)
> It's just even more expensive if you do know.

In the USA. Wilful and unwilful infringement of the patent costs the same in Europe.

Re:H.266/Versatile Video Coding (VVC) by vertex-four on Monday July 06, 2020 @11:24AM (#23748886)
Luckily, software patents are unenforceable in the EU, so for many of us on this site that's irrelevant.
Re:H.266/Versatile Video Coding (VVC) by inthewings on Monday July 06, 2020 @10:21AM (#23748175)
That's what patent trolling is