News for hackers. Stuff that matters.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Cd00d on Wednesday June 01, 2022 @04:11PM (#31587365)
My team used to buy location data that we packaged up into reports for equities investors - the premise being the more foot-traffic your brand had, the more revenue you're likely to have.

Tons of apps sell this info. I think a lot of the 3rd party weather apps have been the traditional worst offenders because everyone wants to know the weather where they actually are in the moment.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by kennywinker on Wednesday June 01, 2022 @05:05PM (#31588110)
I know the "best" way to stop this kind of privacy violation is good consumer protection and privacy laws, but I wonder if we couldn't also regulate the downstream market. I.e. make the sale and resale of personal data, as Cd00d is describing, illegal. It seems pretty proven that the humans doing that buying and selling aren't going to stop doing it out of civic responsibility or moral disgust
Re:Tim Hortons app violated laws in collection of ‘vast amou... by minsc_and_boo on Wednesday June 01, 2022 @05:33PM (#31588427)
That's still whack-a-mole. Even if you changed the rules to selling user data, these apps would just update it in their TOS that consumers agree to without reading.

Even laws have this problem. There are so many cookie bars on websites that users just click through them anyways.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by kennywinker on Wednesday June 01, 2022 @05:53PM (#31588632)
Whack-a-mole by the way the laws are written. You can write laws that aren't whack-a-mole. E.g. "it is illegal to sell or transfer user's data to another company without positive informed consent from the user within 1 month of the transfer"

Every time a company wants to sell on your data, they have to email you and ask permission. Not responding to that message isn't consent.

Find a loophole in that.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by bushbaba on Wednesday June 01, 2022 @07:59PM (#31589682)
Company A sell data to party B. Party B resells the data to party C, D, F without informing company A. Company A & B are owned by the same conglomerate.

Your law as written would only cover company A doing the sale of data to B, but not the downstream intermediaries.

Alternatively, company A doesn't sell the raw data, and instead sells reports and anonymized data that can easily be joined with other datasets. As this is not a sale of "user data", but an aggregated, anonymous insight.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by jen20 on Wednesday June 01, 2022 @10:13PM (#31590501)
“You may not sell the information of any person without explicit written consent for that instance of sale from that person. Aggregation counts as information. Rights are not transferable.”

The data industry is full of scum - nothing less than scorched earth in advertisers and brokers is sufficient at this point.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by orangepurple on Thursday June 02, 2022 @01:02AM (#31591522)
I think global GDP would halve if this was implemented as written!
Re:Tim Hortons app violated laws in collection of ‘vast amou... by labster on Thursday June 02, 2022 @01:29AM (#31591669)
And yet nothing of value would be lost.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by JTBooth on Thursday June 02, 2022 @02:37AM (#31592110)
This would eliminate, like, caniuse.com, wouldn't it? Information about what browser version is used by 99% of visitors to a website is an aggregate of personal information of users of a website.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by labster on Thursday June 02, 2022 @05:29AM (#31592992)
They can get aggregated information as a free service. They don’t have to buy it from anyone, thus not breaking this law.

Aggregation isn’t the real problem. Honestly it’s the crosstabs that are killing privacy. Remove the correlations, and no one gets hurt.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by jen20 on Thursday June 02, 2022 @11:34AM (#31596144)
Fine by me - call it a temporary correction while scummy business models are weeded out.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by anamexis on Thursday June 02, 2022 @03:02AM (#31592246)
The GDPR basically does this in the EU, no?
Re:Tim Hortons app violated laws in collection of ‘vast amou... by mattnewton on Wednesday June 01, 2022 @06:10PM (#31588791)
They’ll just come up with some aggregated form of the data they claim doesn’t violate the letter of the law, sell that, and be in business for years before anyone finds out let alone tries to enforce the rules and find out of they are violating it.

This would honestly still be a huge improvement imo, as even forcing data brokers to anonymize or aggregate the data, even if it is ultimately not actually providing privacy, is still a recognition of the problem over the current system in most states.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by goodoldneon on Wednesday June 01, 2022 @07:21PM (#31589393)
They'll put it in an "updated terms of service" dialog. People always just accept updated terms of service just like they always just accept the initial terms of service
Re:Tim Hortons app violated laws in collection of ‘vast amou... by taneq on Thursday June 02, 2022 @08:44AM (#31594092)
Especially if the terms of service are 147 pages of 6pt text containing nothing remotely concerning privacy, with a link buried in there somewhere to their privacy policy that then has some disingenuous weasel wording on page 14 which might imply that the "legitimate reason" they have for scraping your data is to sell it to third parties.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by runnerup on Wednesday June 01, 2022 @06:03PM (#31588735)
> Find a loophole in that.

Enforcement.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by m463 on Wednesday June 01, 2022 @09:38PM (#31590328)
The loophole is regulatory capture. The laws are written strongly, then watered down by self-interested companies throwing money at the legislative pipeline.

I don't know the answer to this, but it would probably be a crisis of some sort, like cambridge analytica.

It's sort of amazing how far out of hand things have gotten, with phones, cars, televisions, and more collecting data and matching it with your "dossier(s) in the cloud"

Re:Tim Hortons app violated laws in collection of ‘vast amou... by JumpCrisscross on Wednesday June 01, 2022 @08:04PM (#31589722)
> You can write laws that aren't whack-a-mole. E.g. "it is illegal to sell or transfer user's data to another company without positive informed consent from the user within 1 month of the transfer"

The problem is people are stupid and uninformed about giving consent. You're the one trying to loophole around that.

If you actually want to regulate this the way you describe, you have to do it by removing peoples' right to give certain consents. For example, nobody may give consent for more than 6 months for the use or transfer of their data.

This is a big deal! You're removing a free mode of contracting. But if you think about it, we do it all the time. That it has a higher burden of proceeding around new technologies is a large reason why American (where we are careful about rulemaking) and Chinese (no rule of law) tech companies are ascendant. But at a certain point, the usual rulemaking frameworks may need to be applied.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by ABCLAW on Wednesday June 01, 2022 @08:34PM (#31589927)
>The problem is people are stupid and uninformed about giving consent. You're the one trying to loophole around that.

Not really. People have a limited amount of time to deal with issues and aren't trained legally. This doesn't make them stupid. Their inability to suss out all possible downsides of a set of EULAs across various products for a service they're looking for isn't stupidity; it's just an inherently complex space that requires a lot of time and specialist knowledge.

This is one of the main ideas behind consumer law; certain contracts are inherently slanted towards those who draft the contract, therefore we remove some of their freedom to abuse consumers by placing limits on the clauses we're willing to enforce.

That lack of willingness to place restraints on these types of freedom has less to do with the inherent difficulty of restraining freedom of contract and has more to do with the fact that the harm is distributed diffusely amongst a massive swath of consumers, vs felt acutely by specific data aggregators so one side advocates far more for their position - even if that position is antisocial in nature.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by mr-wendel on Wednesday June 01, 2022 @09:46PM (#31590372)
I think good arguments often have to begin with an assertion that "we aren't as dumb as we tend to think" and introduce color that gives the average person the benefit of the doubt. This post does that nicely.

> "Their inability to suss out all possible downsides of a set of EULAs..."

This is the part I quibble with, however. This assumes folks even read legal-speak. Privacy laws have undermined this by forcing more text and more "I see, I agree, go away" links/checkboxes/buttons in front of people. The problem isn't the EULAs, the problem is that no sane person can (or should) keep up with it.

Yes, sometimes people can be surprising. My wife has an awesome t-shirt from MailChimp from a not-so-hidden "if you read this, you get a free shirt!" clause she found in their legal stuff. But relative to the amount of cheap "consent" given, this is a huge outlier.

That said, I also have to give kudos to some of the lawyers I've worked with in the GDPR/CCPA/etc era. At least at the point of purchase, there was no better corporate consumer advocate of "boil it down to two or three crystal clear sentences and link to the details, which must cut to the chase" to be found.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by ABCLAW on Thursday June 02, 2022 @06:05PM (#31601109)
>This assumes folks even read legal-speak.

They obviously don't, but you're missing a key idea; why aren't they?

You can't benefit from reading without expert knowledge, and the cost is a massive time-sink. Even lawyers, with experience reviewing these types of documents, take a substantial amount of time to get through them and note them up.

If EULAs said: "In exchange for this free Solitaire App, we're going to reserve the right to inform your insurance company about which doctors you visit and the government about which abortion providers your phone keeps going to" you'd obviously read it because you can understand what's going on and you'd understand the exchange in a reasonable time-frame.

This situation doesn't exist because people are stupid. People are smart, which is why they aren't wasting their time trying to go to law school each time they need software.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by aaaaaaaaata on Thursday June 02, 2022 @07:25AM (#31593599)
Mailchimp has been sounding cooler all the time, anyone ever had a bad experience with them, inside or out? I'm too close to hero worship.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by tintor on Thursday June 02, 2022 @11:46AM (#31596315)
user's data and any information derived from that data (ie. aggregating, or training a model on it)
Re:Tim Hortons app violated laws in collection of ‘vast amou... by mr_toad on Wednesday June 01, 2022 @06:28PM (#31588951)
You can’t agree to something illegal. If the law makes it illegal for third parties to use location data then it doesn’t matter what the TOS are.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by l33t2328 on Thursday June 02, 2022 @04:12AM (#31592612)
You’re saying it should be illegal for you to decide who can do what with your data?

If I want google to sell my data in exchange for keeping Youtube free, that’s 100% my prerogative

Re:Tim Hortons app violated laws in collection of ‘vast amou... by verisimi on Wednesday June 01, 2022 @06:56PM (#31589197)
> I know the "best" way to stop this kind of privacy violation is good consumer protection and privacy laws

But I don't want any of my data collected or shared!

The laws you are hoping for won't allow that - if they existed, at best they would only allow those companies to whom you have consented. Ie the mega-corporations. Local shops would be the ones without the data. Which would be pretty much exactly the opposite way I would choose to share my data, if I were forced to by law.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by MaxBarraclough on Thursday June 02, 2022 @08:43AM (#31594084)
> I know the "best" way to stop this kind of privacy violation is good consumer protection and privacy laws

I agree such laws are necessary, but I'm not sure they're the best of the various solutions. Technical measures might be more robust, such as fine-grain permissions in mobile operating systems. I'd rather it not be possible to collect my data in the first place, than trust that some developer (in whichever jurisdiction) isn't breaking the law.

An advantage of the web is that hostile code is more easily tamed than in native apps, but in itself this observation doesn't do the user much good. Apps are pushed in part because of their superior capabilities for user-hostile functionality.

Similarly, Free and Open Source software is rarely this user-hostile, as few people have the nerve to publish their user-hostile code for all to see. Again though there's a sort of collective-action problem: if only the abstemious few like Stallman insist on not using proprietary software, things don't improve.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by BLKNSLVR on Wednesday June 01, 2022 @10:14PM (#31590511)
I'm wondering whether the opportunity to legislate consumer protection and privacy laws has long passed because enough companies have sprung up to take advantage of this covert surveillance data flood that there could be relatively severe economic impacts caused by any attempt at trying to dam it.

ie. the political will to make any such changes just may not exist beyond pure lip service to minority who actually know and care.

I've considered what the options would be for something like "privacy-as-a-service", but I get the feeling that such an industry would be more likely to be regulated to death than the one it's in reaction to.

Ironically, "privacy-as-a-service" already exists to protect the financial records of those with big enough financial records to be able to afford said privacy protection service. One law for me, another for thee.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by geysersam on Wednesday June 01, 2022 @11:02PM (#31590817)
The opportunity absolutely has not passed. Widespread smartphone use is barely 3 election cycles old.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Nextgrid on Wednesday June 01, 2022 @10:21PM (#31590560)
I think the opportunity has passed because companies who rely on violating privacy have effectively taken over humanity's social fabric.

Any politician that attempts to regulate this can be thwarted by just shadowbanning any content that mentions them on social media - and he'd effectively disappear for a large chunk of people.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by 7speter on Wednesday June 01, 2022 @10:27PM (#31590590)
Because political campaigns and parties use this data too.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by robertlagrant on Thursday June 02, 2022 @03:05AM (#31592271)
> One law for me, another for thee.

That's not law, that's a service!

Re:Tim Hortons app violated laws in collection of ‘vast amou... by rapind on Wednesday June 01, 2022 @08:59PM (#31590093)
Easy solution is to make user data toxic. Make it a liability. Poison the well.

Make a law where if you ever sell a minor’s data, regardless of whether that minor lied about their age or agreed to a contract (wouldn’t be binding!), then you face steep fines. If you’re found buying data belonging to a minor, also steep fines. If you buy and then de-anonymize data belonging to a minor, really steep fines. To collect and hold data that may belong to a minor, you need to justify it (like GDPR).

Obviously this doesn’t scale for aggregators, advertisers, basically SV, which is the point.

A restaurant is responsible if they sell booze to a minor. A store is responsible if they sell cigarettes to a minor. Serving a minor that lies about their age does not get you off the hook!

Problem solved. User data is toxic. You won’t want to hold onto it for any other reason than a legitimate use.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by toss1 on Wednesday June 01, 2022 @09:45PM (#31590363)
Right direction, not far enough

Steep fines are barely a speed bump to either a profitable business or a scammer. They take years to actually get implemented, don't survive bankruptcy and get reduced in court.

Jail time. Mandatory. Zero room for judges and juries to go easy on the perps.

Even this does not stop white-collar crime, but it maybe slows just a little bit of it.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by rapind on Wednesday June 01, 2022 @10:34PM (#31590623)
Steep fines for “each” occurrence. You can most definitely deter all but the dumbest companies from trafficking in toxic data.

Are you going to buy shares in a company who’s entire worth is derived by it’s user data when it turns out that a significant but unknown amount of that user data is actually a very expensive liability?

There’s always going to be someone searching for loopholes, like anything, so keep it unambiguous and straightforward.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by toss1 on Thursday June 02, 2022 @10:09AM (#31595089)
Yup - also provide for bounty-hunting - anyone who finds a violation gets a share of the fines...
Re:Tim Hortons app violated laws in collection of ‘vast amou... by blip54321 on Thursday June 02, 2022 @09:08AM (#31594363)
I think this would be a better state than we have now...

... but I feel like it isn't the ideal solution. I don't think we should make the perfect the enemy of the good, but what I'd really like to see is that people own their data about them.

I should be able to figure out what vendors have data about me. I should be allowed to be forgotten. There should be severe liability if they don't forget me.

I should be able to contract away my data, but in return for a real benefit, and that shouldn't extend to sale / redistribution.

I don't buy anonymization. De-anonimization is too easy, too good, and progressing too quickly.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by winphone1974 on Wednesday June 01, 2022 @09:53PM (#31590404)
Isn't this the plot of a silicon valley episode after pied Piper pivots to be a chat app?
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Haemm0r on Thursday June 02, 2022 @12:26AM (#31591342)
Selling data? ... straight to jail! ;-)
Re:Tim Hortons app violated laws in collection of ‘vast amou... by amluto on Wednesday June 01, 2022 @05:35PM (#31588455)
I think the best way is to attack the market from all sides.

- GDPR-like legislation to try to prevent the inappropriate collection of this information.

- Ban the sale of or trafficking in illegally collected personal information. Apply serious monetary penalties to anyone who sells such information improperly. Additionally, anyone who sells such information and subsequently learns that it was improperly collected or was GDPR-deleted must tell their buyers, who must then delete it.

- Buyers are liable if sellers are found to have violated the rules and don’t pay. They are also liable if they fail to honor delete requests. Buyers who consider this liability unacceptable may attempt to purchase or require insurance.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by jonhohle on Wednesday June 01, 2022 @05:51PM (#31588601)
> Ban the sale of or trafficking in illegally collected personal information.

In the US isn’t the sale of illegally acquired data already illegal under 18 U.S. Code § 2315?

I wonder if any existing stalking laws would cover existing data collection practices. Most people are upset when they learn there are records of their location down to a meter or so wherever they go that are sold to anyone who wants it. Does that meet the bar of “emotional distress”?

Re:Tim Hortons app violated laws in collection of ‘vast amou... by tlavoie on Thursday June 02, 2022 @01:43AM (#31591757)
Along with blocking commercial creepy behavior, I would love to see similar restrictions applied to governments that use commercial access to simply vacuum up large quantities of this information without warrants. (IIRC, ICE in the US is one well-known offender here.)
Re:Tim Hortons app violated laws in collection of ‘vast amou... by webnrrd2k on Wednesday June 01, 2022 @09:58PM (#31590430)
I wonder... Is there a way to overwhelm them with useless junk data?

I'm just thinking out loud, but maybe send my own phone a bunch of fake GPS signals, say, within my own house? Or maybe, somehow 'trade signals' with someone else in a way that collecting the data is useless? Or store my phone in. Faraday cage when I'm not specifically using it? Im sure other people who know the specifics better than I do will flesh it out better that I have, but maybe this will get the ball rolling...

Re:Tim Hortons app violated laws in collection of ‘vast amou... by Nextgrid on Wednesday June 01, 2022 @10:23PM (#31590569)
AdNauseam attempts to do that with ads: https://adnauseam.io

I was thinking the other day of setting up a bunch of VMs with some browser automation with the goal of aimlessly browsing popular sites with the plugin enabled in the background in order to have most ad providers blacklist my IP for ad fraud and thus not trust any data coming from me.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by addingnumbers on Thursday June 02, 2022 @09:45AM (#31594818)
I only know one guy who used Ad Nauseum, two or three weeks later his gmail account was banned and to this day he has to complete a CAPTCHA every time he visits a Google site from his home IP.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Nextgrid on Thursday June 02, 2022 @09:50AM (#31594878)
That would be a feature for me as I don't use any Google services. A Google ban would be more than welcome!
Re:Tim Hortons app violated laws in collection of ‘vast amou... by raxxorraxor on Thursday June 02, 2022 @03:06AM (#31592274)
Also high retroactive fines because that data collection is illegal in some jurisdictions. People that sell this data aren't stupid.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by ljm on Wednesday June 01, 2022 @10:39PM (#31590653)
This is ostensibly the purpose of GDPR. Selling personal data is illegal unless the person opted in. It's opt-out by default.

The problem is that it's the internet... the law works for honest websites and companies but not for anyone else.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by tremon on Thursday June 02, 2022 @06:47AM (#31593390)
Selling personal data is illegal unless the person opted in

That's not possible to opt in to under the GDPR, FAFAIK. People can consent to the purpose for which their data will be used, and any such purpose must be enumerated explicitly. "Selling the data" is not a processing purpose, and it would still be illegal even if the person consented (it does not meet the bar for informed consent).

Under the GDPR, the only legal way for personal data to be transferred between companies would be for the "buyer" (processor) to use the data original data from the "seller" (controller) on behalf of the controller. The data, as consented to be collected, remains the liability of the controller for its entire lifetime.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by PeterisP on Thursday June 02, 2022 @03:55AM (#31592504)
On the other hand, the main source of the money for the industry - major advertisers - are legitimate above-board companies, who either are honest or are liable for enforcement.

GDPR is not really about selling personal data but about using it; a big part of its effect is on buyers of data since GDPR effectively (there are all kinds of nuances) means that it's not legally possible for legitimate company to simply buy personal data for arbitrary purposes, since the data subject obviously did not opt-in to that particular purpose by that company when the data was collected.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by Cd00d on Wednesday June 01, 2022 @06:18PM (#31588862)
Honestly, I'm not sure it needs to be illegal. I'm not sure it shouldn't be either.

I wholeheartedly admit, some of our data providers are shady, and there's no way I would go work for them. I don't like the way they mislead people.

That said, the data we get is anonymous. Sure, if I know enough about you, and you're in one of my panels, it's feasible that I might be able to figure out which panelist you are. I know there's been some kerfuffle there with less than upstanding "private investigators" and bounty hunters in the past. But, the data we deal with is far too expensive for those sorts.

We find valuable consumer behavior insights the data at regional levels. That creates information that's valuable not only on Wall St, but to retailers and brands, who are desperate for anything to help them understand market share and loyalty.

I dunno. It's a weird world. It's also a very commoditized world. Just having access to the data is no longer the main value add - you have to provide the meaning of it as well.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by ProjectArcturis on Wednesday June 01, 2022 @06:25PM (#31588920)
There's no way to anonymize location data. Where does your phone spend the night plus where does your phone spend the weekday equals a unique identifier when cross-referenced with an address database.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Cd00d on Thursday June 02, 2022 @12:29PM (#31596972)
That's a fair point, and I'm guessing why my previous comment is being downvoted.

I know our location provider did some things proactively - like they would not geofence hospitals, for example, but "home" is likely very visible.

That's a dataset I didn't work on as much, so maybe I'm not being sensitive enough to the "this should be illegal" argument. I guess on reflection misleading you for the collection should be illegal, though how to do that isn't obvious.

What I've worked on the most is people's credit card transaction histories, and that's quite a bit more naturally anonymous, though again, if you know enough about a person they would be discoverable.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by burnished on Thursday June 02, 2022 @02:12AM (#31591939)
Bin it until its anonymous again. Your route is too identifying, but is "people who appear to be driving away from a residential location between 9:30 and 10"? Fun to think about.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by benrapscallion on Wednesday June 01, 2022 @09:22PM (#31590219)
Apple has the option of imprecise location for this very reason.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by dillondoyle on Thursday June 02, 2022 @12:54AM (#31591480)
And they changed permissions to opt in.

Different numbers for different categories, but I've read anywhere between 18 - 25% on the higher end opt-in success.

But above example of weather app is a good trick though, probably gets more allow always on location than FB for instance.

https://www.flurry.com/blog/att-opt-in-rate-monthly-updates/...

Re:Tim Hortons app violated laws in collection of ‘vast amou... by blenderdt on Thursday June 02, 2022 @02:16AM (#31591963)
That assumes the location on the device is used by an app.

But signals your phone is sending can and are also being tracked.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by bisby on Wednesday June 01, 2022 @05:16PM (#31588245)
"We need your location to give you accurate weather readings for where you are. We need internet access to fetch the weather data."

Weather apps also have plausible excuses for requesting permissions.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by derefr on Wednesday June 01, 2022 @05:27PM (#31588370)
Weather data is so tiny that there’s no good reason to not just fetch the whole weather point-map for your country and then select from it client side.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by chongli on Wednesday June 01, 2022 @08:11PM (#31589764)
I just had a look at the per-app data usage on my phone. Out of a total of 5.7GB of data usage, the weather app used 12.1MB of data. Sure, that seems tiny. But I live in Canada where there are over 4000 weather stations. Multiply that by 12.1MB and you get 11.8GB of data usage for the weather app, dwarfing all other apps. Either the fidelity of weather data would have to be reduced, or the update frequency, or a smaller selection of weather stations would have to be downloaded from (those in my area), defeating the purpose of fetching the whole map (hiding my location info from the server).
Re:Tim Hortons app violated laws in collection of ‘vast amou... by dghlsakjg on Wednesday June 01, 2022 @10:41PM (#31590671)
Are you sure that is 12.1MB of weather data, and not 40kB of json and 12.096 MB of ads and tracking data going back to them?

For example, a full month of hourly weather data for a single Canadian station is 131KB (pulling from the Climate Canada site), meaning that if you wanted an hours worth of data for the ENTIRE country you're looking at less than ~800kb.

But if you just limit it to a geographical subset, say the lower mainland of BC, or even just a single town, then you can eliminate pinpoint data about yourself. Knowing that a person is in Abbotsford is far less invasive than knowing that they went to the Shoppers Drug Mart at 8:46 PM after searching for cold medicine.

This isn't a black and white thing, I wish that I had more control over my iPhone. I would love to be able to tell it to report a general location (somewhere random within a 10km of my actual location) to some apps, and a precise location to others. I get that Wunderground has server bills to pay, and I'm not paying them, but I would imagine that there is still a viable ads based business model that doesn't get quite as invasive.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by TheKarateKid on Wednesday June 01, 2022 @11:25PM (#31590965)
> I wish that I had more control over my iPhone. I would love to be able to tell it to report a general location (somewhere random within a 10km of my actual location) to some apps, and a precise location to others.

The iPhone (actually iOS) allows you to do exactly this. You can choose precise or general location on a per-app basis.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by chongli on Wednesday June 01, 2022 @11:03PM (#31590825)
I use the built in weather app on my iPhone. I’ve never seen any ads in it, so I don’t know what “ads and tracking data” you’re referring to. The app does update on a minute-to-minute basis when it’s raining out, though. It looks like this [1] and it doesn’t just scroll left on a local timer. The magnitude of the predictions in the graph change on a minute to minute basis and can disappear entirely, giving a very nice prediction of when the rain will stop so that I can go out and expect not to get wet.

[1] https://iphonesoft.fr/images/2021/02/meteo-14.5-ios.jpg

Re:Tim Hortons app violated laws in collection of ‘vast amou... by derefr on Wednesday June 01, 2022 @08:16PM (#31589798)
I have a feeling that weather data compresses together well — especially if stations 1. are ordered along a space-filling curve geographically, with read-outs of geographically-neighbouring stations in sequence; and 2. are stored column-oriented where each future time is its own column. Basically the same optimizations as you would use to store any other IoT time-series sample-cloud data.

I suspect that, encoded this way, weather for 4000 locations wouldn’t be much bigger than weather for 1 location.

Also keep in mind that half the reason the Weather app needs to use as much bandwidth as it already does, is that whenever you move even slightly, it can no longer give you accurate info without grabbing the point-forecast again for your new location. It uses far less data if you just stay at home all day every day. If it had a pre-cache of forecasts for the entire local area, it wouldn’t need to do that; it could just refresh once every few hours. Maybe even wait for you to be on wi-fi before doing so, if it has modelled you as usually connecting to wi-fi several times daily.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by chongli on Wednesday June 01, 2022 @09:12PM (#31590174)
I think the bigger issue is the update frequency. My weather app updates minute-by-minute, giving me essentially real-time precipitation information from my neighbourhood weather station. If each future time is a column, you're looking at 60 columns just for the next hour of forecast. It really adds up!

This level of detailed information can't be pre-cached, either. I believe they are feeding the real-time weather recordings from the weather station into their supercomputer model to generate minute-by-minute high resolution forecasts over the next 6 hours.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by brewdad on Wednesday June 01, 2022 @10:51PM (#31590740)
Look at the METAR data pilots use for an example of how easily weather data can be compressed.

KSEA 020153Z 34008KT 10SM FEW075 OVC090 18/14 A2997

Here's the local conditions at Sea-Tac at 7:15pm Pacific time. We have wind direction and speed, visibility, cloud conditions, temperature and dew point and barometric pressure in one small snippet.

The forecast data for the next 24 hours is given similarly. Radar data would be more complex but the basics for any weather app are only a handful of bytes.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by skykooler on Wednesday June 01, 2022 @10:59PM (#31590790)
I wonder how big METAR weather data and forecasts for the whole of the US would be to download?
Re:Tim Hortons app violated laws in collection of ‘vast amou... by brewdad on Wednesday June 01, 2022 @11:26PM (#31590978)
I can't find the source but I believe there are about 4000 METAR sites. There are plenty more small airports that will issue a weather report but they are pulling from the closest site that actually records METAR data.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Scoundreller on Wednesday June 01, 2022 @05:19PM (#31588285)
Though I enjoy that apple at least let’s me give imprecise location to most maps. Would be nice if I could set it myself to X kilometres.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by xattt on Wednesday June 01, 2022 @07:56PM (#31589651)
Using the built-in iOS app for nowcasting has been good enough for me.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by SoftTalker on Wednesday June 01, 2022 @06:02PM (#31588716)
I can look out the window and see what the weather is where I am now. Beyond that I am interested in the weather for my general area over the next couple of days, which is imprecise enough anyway that my exact location doesn't matter.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by Cd00d on Wednesday June 01, 2022 @06:23PM (#31588897)
I use the 6 and 12 hour forecasts every single day, personally. Simple stuff like - is it going to rain while we go to the playground, what's the UV going to be while we're at that outdoor thing, how cold is it going to be after I go to bed and do I need to close some windows... that sort of thing.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by maccard on Wednesday June 01, 2022 @06:22PM (#31588896)
Can you tell whether it's going to be raining in 30 minutes? Can you tell whether it's going to be 10 or 22 degrees later today when you're up at 7am?

I definitely can't do either, and ive been wrong enough times to know that

Re:Tim Hortons app violated laws in collection of ‘vast amou... by johncoltrane on Thursday June 02, 2022 @02:24AM (#31592017)
I distinctly remember a time when all we had was tomorrow's forecast on TV after the evening news and/or today's forecast on the radio before the morning shower. And before that, it was mostly looking at the sky and listening to our intuition.

We were _fine_.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by maccard on Thursday June 02, 2022 @05:29AM (#31592990)
Im not going to claim that everyone needs live access forecasts all the time but to claim that there is no benefit to having live access to forecasts is just silly. Sure you were fine, but that doesn't mean that what we have now isn't better.

> 's forecast on TV after the evening news and/or today's forecast on the radio before the morning shower

I don't know about you but I certainly don't want to watch the news or listen to the news and traffic reports to get the weather. I'm _very_ glad we've moved past that

> And before that, it was mostly looking at the sky and listening to our intuition.

Really, your argument is that things were fine before we had instruments so we don't need them?

Re:Tim Hortons app violated laws in collection of ‘vast amou... by kingaillas on Thursday June 02, 2022 @11:58AM (#31596472)
>I distinctly remember a time when all we had was

Sure, and I remember a time before internet (widely available public access) and smart phones. We were also fine.

Which doesn't mean these advances (including forecasts) aren't useful.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by brewdad on Wednesday June 01, 2022 @10:58PM (#31590786)
Well no, but the daily forecast gives me a good enough approximation. If I know the temp in the AM when I get up and I know the forecasted high, I can get a pretty good guess of what midday temps will be. If a massive front is moving through that will lead to significant changes, well the forecast will capture that too in wind and precipitation forecasts.

As for the next 30 minutes, I have tried AccuWeather and DarkSky. Both get the timing wrong about as often as they get it right for my location.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by maccard on Thursday June 02, 2022 @05:24AM (#31592965)
Those daily forecasts are highly localised though. I live in a city with half a million people that has its own little microclimate because we're surrounded by large hills on 2 sides and ocean on the other two. A general forecast for even 20 miles around us would almost certainly be wrong.

> As for the next 30 minutes, I have tried AccuWeather and DarkSky. Both get the timing wrong about as often as they get it right for my location.

Anecdotally here the met office is right far more often than it's not.

Re:Tim Hortons app violated laws in collection of ‘vast amou... by xhrpost on Thursday June 02, 2022 @09:39AM (#31594730)
I recently added AccuWeather back to my device. I didn't permit continuous access to location and it kept an incorrect city for the desktop widget. I was tempted to give full access but now I realize I'm best to just delete the widget at least and double check permissions.
Re:Tim Hortons app violated laws in collection of ‘vast amou... by willstrafach on Friday June 03, 2022 @11:59AM (#31610129)
They have some pretty bad past practices: https://www.zdnet.com/article/accuweather-caught-sending-geo...

And they have continued, off-and-on, to use other location-collecting SDKs.