> It is modifying what the artist intended you to hear in a destructive way. It is destroying the original performances.
also applies to lossy encoding.
The whole point of audio watermarking is that it survives lossy compression. Inaudibility is merely a secondary concern.
This is an adversarial relationship, and one that the audio watermarking is doomed to lose. By and large, lossy codecs succeed in transparency, and therefore as an inevitable consequence, watermarking fails at it. After decades of development, lossy codecs are just too good - there's nowhere left to hide information.
(It's also worth noting that the consumer benefits from the quality tradeoff that compression makes, in the form of decreased storage and bandwidth. They don't benefit from the audio watermarking at all.)
I'm unable to load the article and haven't heard one in real life, but in theory it could be done in a way that is imperceptible to human ears but detectable by a program. E.g. imagine masking specific frequencies within a noisy section of the video.
There should be less destructive ways for studios to do this, but unless it's in the video or audio signal it doesn't stand a chance of working reliably.
[1] https://creativepro.com/major-movie-studios-specify-digital-...
[2] https://partnerhelp.netflixstudios.com/hc/en-us/articles/440...
To be clear, I'm also against any kind of watermark, but I'd rather it be done with an imperceptible (to me) audio signal than with a constant graphical watermark as is usually the case. Actually, graphical watermarks could be smarter and less obtrusive as well.
> The difference is that the graphical watermark on e.g. a photograph usually isn't there when you've paid for it.
The same could be the case for these audio ones. It's user hostile if this is done on already paid content (but again, I can't read the original article to confirm).
As for more subtle changes, what constitutes a "plausible sound" in any given context is an AI-complete problem. Sure on a particular song, you might get away with e.g. tinkering with the reverb a bit, or changing the tempo by 0.5% - but how can you possibly do that in the general case?
Remember - all such changes have to be audibly salient to humans, because that's the only thing guaranteed to survive.
You’re saying it’s ok to decimate it - as long it’s replaced with some “plausible” proxy? Plausible decided by who, the artist or business requirements?
We tolerate Netflix releasing films in less than 4k. They do that because of a practical business benefit (cost). Similarly, Universal is making a compromise in the artist's vision to meet a business requirement. I think if the compromise is sufficiently small and the business benefit is sufficiently large, it's ok to do this.
When you're passive listening, you're only perceiving the "outlines" of the music, but listening actively reveals a lot of details, and this kind of wobbling becomes both more noticeable and disturbing.
When listening the music actively, anyone can distinguish between natural and unnatural sounds, and this will bother many people if they listen more actively.
This of course would mean the watermark would not survive transcoding from lossless, but as we can see in TFA the watermark can be made useless all the same without such efforts.
With that said the oxygen malpractitioners that run the music industry have never put actual consumers' satisfaction above implementing trivially circumvented security theater, so pirates win all the same in all scenarios.
However, encoding a series of highly discernable tones into the audio is just dumb. Instead they should use phase modulation at low frequencies. Current compression models don't play with subtle changes of meter much, because they mostly use local encoding and there's not much room for improved compression with (non-audible) modulation. Of course, if Universal wanted to be able to accurately detect 5 second clips (rather than 2 minute songs) this would be a lot more difficult... and of course they want every thing, at the expense of listener experience.
The system is called CBET and it's based on the psychoacoustic model as well, except it determines the level at which watermark should be injected at. High enough that it passes codecs easily, but just below perception so you generally can't detect the tones that it has added to the audio.
The trade is that CBET only moves about 8 bits/second of information through the side channel, which is just enough to push a station ID and timestamp through the channel for Nielsen's ratings purposes.
However I'm awfully curious about this system, especially "high enough that it passes codecs easily". I would naively expect that to be highly dependent on the codec and bitrate chosen, and further expect the range between "inaudible" and "codec-passing" to be negative for many common untransparent lossy profiles, like 128kbps mp3. Where can I read more?
There are 10 bands, each of which can carry 1 of 18 tones. 16 tones are to signal, so the stream is 4 bits wide, and the other two tones are used as a "STOP" and "SYNC" marker in the data stream.
All bands carry identical information, but each bit within a band is encoded with a different tone than any other band. So, it appears random or uncorrelated at first glance, but you can see the pattern pretty quickly if you do a long enough analysis. The same message gets identically repeated 12 to 13 times per minute and the message only changes once per minute. Here's an example isolation of the signal [1].
The coder monitors incoming audio and does a psychoacoustic pass to determine which level the tones should be injected at. If it can't find a good level for a tone, it uses the lowest possible level... which usually works out fine due to the 10 redundant signals in the watermark.
Encoders like MP3 see the injected tones as signal and will make the bits available to ensure they're encoded rather than correctly masking them out as non-audible material. The 10 bands help here as well, as even if the encoder fails to code the signal in one band, there's usually enough redundant bands that you can successfully decode the watermark.
A transmitter could transmit a weak signal in a specific pattern on a number of arbitrary preselected frequencies. They would more-or-less seem like noise lost in the noise floor. Only when you specifically filter for the specific set of frequencies can you discern the pattern that was put there that could not appear by chance. You don't even need to use the same frequencies throughout the transmission. As long as the schedule is decided up-front it can serve like a one-time pad for encryption.
You're assuming that perceptual audio coders do a perfect job at encoding what can be heard* and not encoding what can't be heard*. This isn't true in both directions — they encode detail that can't be heard* in the source, and lose detail that can be heard in the source*.
*This is contextual, depending heavily on the listener and the listening conditions.
There is. Audio watermarking is inherently audible, because that is the only way to avoid being stripped out (deliberately or inadvertently) by the incredible technology we have for removing inaudible information from audio recordings: lossy audio codecs. The artifacts must be so salient that the codecs deem them important, audible information - codecs designed with elaborate psychoacoustic models, especially to make that judgement call with maximum efficacy. There's no way out.