As per HN thread last week
It's probably easier to do and every bit as accurate as just using a screenshot.
And it's still exactly what I don't want them doing. There's literally zero reason for LG to be building an advertising profile on me because I was foolish enough to buy one of their TVs. This isn't something that makes their products better, it's spying.
Here's how it's been done in the past
https://www.cameronmacleod.com/blog/how-does-shazam-work
Audio is a bit easier to turn into a fingerprint for identification vs video. Video has a lot of smaller subtle changes that happen from things like compression which make it a lot harder to identify. It's why youtube still hasn't figured out piracy, but they'll knock you immediately if you play 5 seconds of copyrighted music.
Eventually, a digital signal needs to be converted into pixels on a screen. Once that happens, it's trivial to also pipe those pixels into a screenshot.
It's the reason DRM for digital media is pretty dumb IMO. The most sophisticated DRM still has to be decoded at some point for the end user to enjoy it. It can always be broken with a camcorder (though quality suffers). However, there exists devices which decode the HDMI signal so doing a pure digital signals.
Audio is much easier to fingerprint and match against content.
When I buy something from the store, my relationship is between me and the store, for the 30 seconds it takes for me to pay for it. I don't want an ongoing relationship with the device manufacturer. I don't want to be tethered in any way to the manufacturer. I don't want to have an account with the manufacturer. I don't want the device sending anything to the manufacturer, advertising related, telemetry, or even a single bit "user has used your product." Do you get it, manufacturers?? I don't want any kind of relationship with you! I want to purchase my product and use it by myself not with you.
I think it depends on the device. If I buy an iPhone, I have the expectation of installing apps on it after purchase, and that necessarily involves a relationship with the app store provider (ie. Apple), not the store I bought the phone from.
With a TV, I suppose it depends on whether I want to install media apps like Prime Video or Netflix on it. I understand that there will be people who don't want that, in which case I agree with you. But others want to be able to run this stuff somehow, whether it's directly on the TV or via some HDMI device like a Chromecast or a Fire Stick. At that point, they _do_ want a relationship with some hardware manufacturer so that the third party app can be delivered to run on the hardware.
This is only true because Apple dictates it to be so. The manufacturer of the device should not have a say in what I choose to do with a device I bought. I should be able to install software on a device without asking the manufacturer for permission. Why do they think they should have an opinion? After I purchase the device, it's mine, not theirs. I can throw it off a cliff if I want without asking for Apple's permission, why can't I install software on it?
> At that point, they _do_ want a relationship with some hardware manufacturer so that the third party app can be delivered to run on the hardware.
The device manufacturer should not need to be involved with a user's decision to install software. There should not be this requirement to have a relationship with them. We should never have allowed this idea to be normalized that the device manufacturer needs to be somehow have a say, let alone be the sole path to using the device.
Device manufacturers should sell devices and then get out of the way of what the user is doing with those devices.
Also, if someone provides a service (e.g. Netflix) that some might want to use and some might not, then you have the option to use that service might be helpful but even that should not require any relationship with the manufacturer unless they are also providing the service. If the manufacturer is separate then they should not have anything to do with it (e.g. they should not add a button on the remote control specific for Netflix; if they have user programmable buttons that you can add your own labels, then it would be possible to use such a thing like that if the end user decides to install Netflix). (There are other problems with Netflix too but I am ignoring them for now because that would be a separate discussion.)
(When I buy a pocket supercomputer, I have that same exact expectation. It's often left unsatisfied, but I still have it.)
There's no possible world in which a gate can be installed in the wall of the garden?
I don't know. It's a gate that allows a person to leave the garden. It exists to be opened, and to be passed through, and also to be closed again -- or to be left open. :)
(The UAC prompt in Windows is also a gate, if existing work is to be studied.)
I bought my Pixel from Google and don't want any relationship with Google whatsover. In fact, I wiped the stock OS and installed Graphene for this reason. My apps come from various sources, none of which is Google.
That's because Apple supplies both the hardware and the software. Being a software supplier - the only such supplier - they need to keep being involved. This wouldn't be the case if third-party OSes existed for the iPhone - it doesn't need to be the case for M1/M2 MacBooks, for example, thanks to Asahi, or for any x86-based hardware.
Truly though, smart-home stuff runs the whole gamut of privacy and device manufacturer relationships. eg: I have used three different smart/room AC units:
- one requires its own cloud-enabled app for any remote connectivity, no HomeKit integration - one integrates with HomeKit but then leaves an upgrade hint that can only be done through an app with a login - one integrates with HomeKit and pretty much just works
HomeKit then allows me to remotely control via HomePod/AppleTV acting as a router ... of course this is just a different cloud connectivity but with on-premises devices controlling other on-premises devices.
For each manufacturer of smart devices, there is potentially a separate cloud where data is being funneled through. Some devices support multiple upstreams.
I get that Matter should be a way to fix it but the reality feels more like https://xkcd.com/927/
Part of me just wants dumb devices back. Get rid of buttons on a microwave (just give me a knob for time and maybe another knob for power setting.) Remove touchscreens from cars (mine glares at me with certain sun-angles.) Bring back the desktop/computer hutch and phones that don't live in your pocket. However, having the ability to start cooling my bedroom 45 minutes before I arrive home is ... pretty compelling too.
When I'm sitting in my home and I want to turn off the AC unit in the other room or close my garage door, there's no reason I should have to do an IP roundtrip to the manufacturer's server. Both devices are on my LAN. They should just talk to each other. This has been a solved problem for decades.
(I know this doesn't change what Vizio did, but it might get your perfect device back)
If you can firewall your LAN - you can also firewall your WiFi.
IMO, the moment a device starts doing that, I’m setting it on fire.
Huh? Your WiFi is (part of) your LAN.
I’m pointing out safe or not has nothing to do with it being on a LAN or not.
Notably, a device can even route all command and control through a cloud service, including sending copies/hashes of all accessed content AND serve just local (as in physically connected) media/content even, if it has a network connection.
This has been an issue since BluRAY at least, where players have the capability to check physical media licensing and deny/brick BluRAY media based on network updates of the keys, and could run Java apps which had network access. So at least 20 years?
The only way to prevent that is to firewall off or physically disconnect any network access.
In this example, for instance, I bet these LG TV’s will happily send all this info even if no one is using any network or app based media streaming at all.
I'm not really sure what the disconnect is here. This seems like the obvious meaning of "works over the LAN" and it means, by definition, that you can control the device without letting it access the manufacturer's servers.
A LAN (or WiFi) typically has routability to the Internet (though doesn’t have to, of course!) which is why what you are saying is confusing. It has for at least 20 years, and is especially true in residential, but also true even in commercial.
Those some IP addresses could also be NAT’d, and often are.
Most modern products have also spent significant R&D figuring out how to bypass NAT and firewalls and even hide from packet inspection (tunneling DNS and command and control over HTTPS, for one example).
Very few people are able to handle or setup actual air gapped LANs now (or isolated VLANs), but anything besides that is risky in these scenarios.
Are you real?
Something you can just scan a QR code with your phone and it hooks it into your backups so your "cloud backup" is sitting in your utility room at home instead of being "someone elses computer"
Obviously this is all achievable by a savvy techie, but I'm thinking along the lines of a black box any idiot can use.
The idea is very appealing to me, I would love to decentralize "the cloud" for your average person.
And if it were possible to get one of these in every house and apartment, then the idea of a "smart home" starts to really click in ways it doesn't right now. Your smart home would have a "home cloud" box that acts as the brain
Idk. I think there's a product idea here somewhere but ultimately it's just something I'm kicking around now and then.
Your average ‘idiot’ can barely get a managed App to work, and that typically requires some kind of cloud endpoint to co-ordinate.
Other stuff is the land of prosumer.
Remote access without the central server seems to make direct attack easier?
1) multiple wifi networks 2) ‘guest mode’ wifi networks (you can’t communicate to other devices on the same network) 3) various airplane mode type scenarios where they have cellular but not wifi connections semi-randomly, even on the same property/area.
these all happen with out of the box ISP setups pretty regularly, btw.
and they’ll just blame you for the flakiness.
also, for most of them, they love remote access anyway and don’t want to consider the security implications.
I feel like the world is bossed by people who read (well, ok listened to a 5 minute summary on a grindlife podcast at 1.5x speed) about the Trojan Horse and thought they smelled a business opporunity.
Unless the piracy is silent, surely audio fingerprinting would catch it?
the whole DMCA/Takedown process is another shenanigan ripe for abuse. Not real copyright enforcement.
It's going to be so easy to determine who you voted for, given a record of every TV show and news programme you've watched, to 90% accuracy. Or to determine if you'd be a "corporate culture fit" when you're next looking for a job. Or an apartment. Or to find whether anything matching the hash of some trade secret documents was displayed on your TV (or ever connected to it [1]) - the "advertising" firm will be forced to hand over documents on you through lawsuit discovery and the wonderful 3rd party doctrine.
Have you been watching media associated with "woke subversion"? "Islamic extremism"? "Far-right hate"? "Incitement to subversion of state power" [2]?
They're not building an advertising profile. They're building a profile. Ads are just the most common known use-case at the moment. But the profile will remain long after ads become the least of your concerns. Consider how such a profile would have been used during the cultural revolution.
If the government required you to submit a record of every book you read or own, people would rightly freak out. How is this any different?
[1] LG Smart TVs log USB filenames and viewing info to LG servers - https://news.ycombinator.com/item?id=6759426
[2] Hong Kong's Tiananmen activists sentenced to up to seven years in prison - https://www.bbc.com/news/articles/cvgyvk2djk4o
And there's of course also Sinclair's law, so even people who should know better might be either willingly ignorant or just not care if it means that they can maintain their quality of life, moral bankruptcy be damned. Similar arguments can be raised for example with the anthropogenic climate catastrophe or other abhorrent phenomena where there's a big chasm in the knowledge between laymen vs experts.
It is exceedingly difficult to convince someone that something is a problem unless said problem is staring the person in the face.
so they aren't even denying listening in on everything?
They still claim to get your media's audio, but deny using the microphones.
1. The introduction says that Smart TVs are not included in this ToS ("not including Smart TVs").
2. Where do the terms say anything about "sensitive" content? The closest thing I see is section 4.d, but that's just about wiretapping/privacy laws in general.
Other people have mentioned there's other voice features like diction/voice control, so it's plausibly for that.
Gamers Nexus discovered recently, through their "AMD blacklisting" bit (when some relatively minor mid-lifecycle refresh of a product they didn't get a demo unit, so it turned into some "we are the truthsayers!" bit), that doing the Louis Rossmann routine earns them loads of links and clicks. So they're firmly in the cry wolf territory now, and it makes me more dubious of their claims that the people they are questioning.
This whole space is filled with bullshit now. Saw another video where a big channel talks about why TVs are so cheap now, and they then explain it that it's because they sell your data. In the real world, the selling data bit, ACR, and so on, is absolutely tiny dollars business. TVs are cheap because massive factories are pumping out these almost entirely plastic products in enormous numbers, and they're extremely cheap to make, and the IP has all been long amortized out.
> In the real world, the selling data bit, ACR, and so on, is absolutely tiny dollars business. TVs are cheap because massive factories are pumping out these almost entirely plastic products in enormous numbers, and they're extremely cheap to make, and the IP has all been long amortized out.
Unfortunately that part if your comment is provably false in at least one instance: Vizio. It's a shame, I thought we were on the same page about spreading half truths.
Vizio's numbers are famously public due to its recent sale. We know they lost money on most televisions sold (not all!), and they made it up in ad revenue and content distribution from those TVs. It doesn't prove that LG loses money on its TVs, but it's clearly not as clear cut as you make it out to be.
Vizio's numbers were public because they went public in 2021 and like every public corporation they have to report numbers. The sale to Walmart actually made their numbers private again because while they're a part of public company still, it's now thoroughly washed in such a mass of numbers it disappears in any quantifiable way.
> It doesn't prove that LG loses money on its TVs, but it's clearly not as clear cut as you make it out to be
How clear cut do you think I made it? You seem to be claiming my comment said something it didn't.
TVs are being subsidized by secondary businesses for some vendors, to some degree, but that isn't why TVs are cheap. If you completely removed that factor, some makers would be slightly more expensive...but not by that much at all.
Like people do a lot of clever positioning to grossly overstate how much they make from this. And it's worth noting that much if not most of the revenue people ascribe to "ads" or privacy invasion on Vizio, actually came from their Connected+ platform. Vizio had a platform, just like Apple does, and just like Apple they took a cut of every subscription signed up for, or piece of media purchased.
I remember back in the day when laptops had a bunch of pre-installed junk and stupid stickers all over them -- at least in the Windows world -- and people would claim this "subsidized" the laptop. That it made it much less expensive. Some people ran the numbers and it was utterly marginal, but they did it because the average person simply didn't care. If they just increased the price the tiny amount and removed that shit the product would be better, but if most people don't care and you can eek out a tiny bit more, they do it.
> Saw another video where a big channel talks about why TVs are so cheap now, and they then explain it that it's because they sell your data. In the real world, the selling data bit, ACR, and so on
> is absolutely tiny dollars business. TVs are cheap because massive factories are pumping out these almost entirely plastic products in enormous numbers,
Right, and Windows Recall is not technically spying on what you're doing etc. etc.
It seems to me like you're being pedantic but essentially end up seeming like shady corporate practices are fine with you over somewhat inaccurate claims that nonetheless point to a real problem?
Yes, TVs aren't cheap because of (only/primarily) ACR but the points stands that ACR shouldn't be a thing on a TV I fully paid for and nobody but me, who paid for the TV, should 'own the glass'.
What is anonymous: we record all the hashs from all the programs people are watching to identify people watching the same thing.
What is not anonymous: we hash all the content in the world, along with hashing the content people are watching, and reconstruct what they watched.
It apparently is.
Do you know the Nielsen Ratings? That's exactly how they know what people are watching these days. I've been contacted by them to be one of their subjects. They ship you a device that listens and recognizes based on content. They look for certain "fingerprints" in the audio and match against that - it's not capable of recording our conversations, etc (or so they claimed).
Streaming services watermark the video as opposed to the audio as I understand it.
But that's for tracing pirated content back to the originating user account. It's not particularly useful (also entirely unnecessary and overly complicated) if your goal is to ID a piece of content as opposed to an account.
That can't recognize what you say. But, it can ID where you are in a specific show out of zillions of hours of shows.
A quick search for “audio steganography” should answer your question (and be a fun rabbit hole if you find that sort of topic interesting)
What we watch is not OK to be fed ads, especially if I wasn't using their service to being with and its monitoring the audio from any input to do this.
In this way, smart tvs and smart home devices are effectively hostile devices behind your router at home.
Trifecta: Piracy + Local media server + Streaming device, either Apple TV/Android TV (without internet access).
No loss of quality, devices that could spy on you, don't, and those that would spy on you, can't. The only trade-off is some convenience.
Apple TV, Android TV or other devices are perfectly capable and better integrate with mobile and other devices in your network.
The tradeoff consumers are sold is trading convenience of in device apps for security.
Smart home devices like TVs, and thermostats should be treated as default hostile and isolated on a guest wireless network instead of your main one.
I've been trying to learn how to secure LG TVs, and saw that some people do seem to jailbreak them withan open version of webOS.
It’d be wonderful if we had a grapheneos equivalent for tvs. They’re very capable Android devices. Such a pity “we don’t own the glass”.
When Nielsen first started collecting data (1950s), they handed out diaries to a group of around 5 000 selected households. Nielsen would then collect these diaries and extrapolate viewing patterns across the entire population.
After that came phone surveys. Next step (1980s) was the "people meter", a small box attached to the TV that could automatically detect which channel was tuned and which household members were in the room.
In the 1990s the set-top box made all of that redundant as the cable and satellite providers could directly see which channel every single box was tuned to at all times.
Poor Farnsworth. He just wanted edutainment, man.
Both audio (sports) and video (netflix et al) watermarks are alive and well. They are used to trace piracy (ie account ID), not for content ID (at least AFAIK).
If you explained how the box was hooked up, it would be easier to judge whether there was a chance you were correct.
As it is, your description isn’t even clear whether or not the box contains a microphone.
(your car infotainment also likely has nielsen tech in it most likely, as they bought arbitron and gracenote)
It's been done for at least good 15 years.
I participated once or twice a good number of years ago, and it was kind of a pain: It involved keeping a paper ledger of what was watched, and when. Correspondence was all handled by regular mail.
(As I recall, they included a small amount of cash ~every time they sent more correspondence and this was a primary motivator to keep going with it.)
In what way? Dramatically lower processing and signature complexity. Audio signature matching is trivial and extremely well known. I see absolutely nothing implausible about this, and it seems a robust, viable solution.
> This paper from 2024 investigated both Samsung and LG and found that they both capture screen images for ACR, and send the resulting hash (not the raw content) back to the manufacturer for identification.
That paper found no such thing. That paper actually demonstrated that they have no clue how the ACR happened, they just demonstrated that playing content yielded content IDs. It is more likely they were witnessing audio ACR happening, exactly as LG described.
- ACR uses audio fingerprinting
- ACR does not collect screen recordings
Both can be true if the TV hashes the frames locally and ACR “collects” the hashes.
To me, this is really an admission.
Spying on people without explicit consent (in a situation where you can say no without penalty) is the issue.
Wrong. They claim it doesn't record video. Recording means saving permanently - live processing is not recording. ACR is processing the video output live.
Notice what they don't say at all. ACR is just one type of spying. A completely separate feature records what you say from the microphone. They only claimed ACR doesn't do that, which we knew. They did not claim the TV doesn't do that.
This is a carefully crafted PR statement, to avoid saying any lies while making it sound like the accusation was wrong, but it does not actually say the accusation was wrong. We can infer that the likely reason it doesn't say the accusation was wrong is that the accusation is right. Instead, it says several other things, which sound like they are refuting the accusation but are actually refuting other things that nobody said.
Debatable and definitely semantic - at the very least this requires putting the audio into a buffer, so a newly mallocd block of memory. Sure, it’s not a recording in a conventional sense, but it is a copy of data.
They are claiming three things:
1) that the speaker (the electromagnet and cone) is not processing any video data, and that it is not performing any analysis of the audio data.
2) All the data the speaker gets is processed by an ``ACR'' processor.
3) The ACR's audio fingerprinting algorithm does not use video data.
It says nothing about whether the ACR fingerprints or sends other data, or if there is a "VCR" or some other chip that separately processes the video. It definitely doesn't say anything about the processing done on the server side, whether they can sell residential proxy access, etc, etc.
At least my TCL TV has a physical switch to disable the microphone (and has never seen the internet, of course). It complains the switch is off at boot every once in a while. There are no complaints about the network unless I accidentally push one of the eight "Google, spy harder!" buttons on the remote.
And specifically, they are not confirming or denying that video fingerprinting are done.
What I think is likely is, as the paper states, that they fingerprint both audio and video. Upload both to their servers. But they end up using only the audio fingerprint for ACR. In this situation, neither LG's statement, nor the paper's statement, nor the GamerNexus folks's claims are incompatible with each other.
It even makes sense from a technical standpoint: it is far easier to uniquely identify content by audio than by video, as a fingerprint of a few milliseconds of audio is pretty darn ideal, compared to fingerprinting even a single video frame which has hundreds of ways it could be compressed depending on codecs, bitrate, resolution, etc.
I could probably come up with a use for that, but it's about as likely as coming up with a plan for one of the Raspberry Pi Zero Ws that are sitting in the drawer.
We probably shouldn't: doing any of this horseshit is a good reason to return a product. We should start doing that en mass until they get the idea.
At that time during testing Cognitive could literally see what we were playing on our TV (not full video but the frames used for fingerprinting)
They don’t use Cognitive anymore for obvious reasons and there are several audio based ACR solutions but they always had issues with sections of video without much audio to work off of so we’re always considered inferior. They are fine for usage data however.
Anyway my $0.02
To be clear: I do not agree with any of Samsung's and LG's efforts to record sounds/words from user homes!
> ACR uses audio fingerprinting technology using the TV’s internal audio processor (not a speaker) to identify content and does not collect screenshots, screen recordings, video recordings, voice recordings, or other audio recordings from the TV.
So they are claiming that ACR is done entirely through audio processing, and no visual data from the screen itself is used? That...doesn't seem plausible.
This paper from 2024 investigated both Samsung and LG and found that they both capture screen images for ACR, and send the resulting hash (not the raw content) back to the manufacturer for identification.
https://arxiv.org/html/2409.06203v1
We're going to have to get saavy in pulling apart the distinction between "I look at everything and then send a nice summary back to my manufacturer" and "I send everything back to my manufacturer". As AI gets cheaper and more efficient, it'll be baked into everything, and will distill signal at the edge and send the good bits back to central command. I fear the legalese in the ToS will obscure this new way of "not collecting" user information.