News for hackers. Stuff that matters.
Re:What Happened to Wirecutter? by charlie0 on Tuesday August 22, 2023 @10:23PM (#37231178)
Wirecutter used to be good, but then it got bought by NYT. I'm surprised at how difficult it is to find legit reviewers in general. I don't trust these larger companies to give us non-biased reviews.
Re:What Happened to Wirecutter? by krackers on Tuesday August 22, 2023 @10:30PM (#37231222)
Consumerlabs, consumer reports, rtings, and which.co.uk seem to be the only standardized independent review bodies I'm aware of.
Re:What Happened to Wirecutter? by bombcar on Tuesday August 22, 2023 @10:42PM (#37231278)
Consumer reports at least is known to be gamed (and they have specific review methodology you need to understand and interpret).

It’s hard

Re:What Happened to Wirecutter? by rootusrootus on Tuesday August 22, 2023 @10:49PM (#37231319)
> Consumer reports at least is known to be gamed

I'd be interested to know more about this, but I haven't found much discussion of it when I search. My google fu may be weak today.

Re:What Happened to Wirecutter? by gandalfgreybeer on Tuesday August 22, 2023 @11:26PM (#37231514)
Not related to the topic on hand but I’ve felt my google fu diminish significantly over the past years. Not sure if it’s me or my google intuition just not matching the current algorithms
Re:What Happened to Wirecutter? by Baeocystin on Tuesday August 22, 2023 @11:58PM (#37231693)
It's not you, it's google. Seriously.
Re:What Happened to Wirecutter? by seventytwo on Wednesday August 23, 2023 @02:55AM (#37232661)
It’s google.

Try Kagi.

Re:What Happened to Wirecutter? by somat on Wednesday August 23, 2023 @02:27AM (#37232465)
On the whole I think consumer reports is one of the better review organizations out there. but for a hint of reader betrayal read up on what they did to the suzuki samurai.

It is not exactly cut and dried, but it was found that consumer reports was testing to get a specific result. And due to the trust that people put in consumer reports that result killed the market for the samurai in the US.

Re:What Happened to Wirecutter? by pseudalopex on Wednesday August 23, 2023 @02:52AM (#37232631)
Any examples after 1988?
Re:What Happened to Wirecutter? by somat on Wednesday August 23, 2023 @04:28AM (#37233273)
Not really, Like I said, I think they are one of the good guys, I am not sure if their testing methodology is any better than any one else. But they do try hard to remain independent from the manufacturers. I think of it as one black mark on their record and a reminder that even our heroes can slip up.

By good methodology I think the best is the person who has a fleet of the things and a deep understanding of how they break, the next best is to take the thing apart and apply some industry specific analysis to it, then test it to destruction to see how it breaks. Ether one is beyond the grasp of the average joe, who only wants to buy one of the things and have it work. And almost no reviewers do this which is why the ones that do are so valuable.

Re:What Happened to Wirecutter? by bombcar on Wednesday August 23, 2023 @06:48AM (#37234032)
Exactly this - they do try to remain independent but they sometimes obviously have biases towards certain operations of things.

For example, the only thing I care about with toilets are that they don’t break and they always flush and clear. Literally nothing else matters, but to test that you gotta poop in them and that’s hard to reproduce scientifically. So weird substitutes like golf balls and whatnot are used instead.

It’s also an integral problem with new car reviews, because you can’t review the durability of a new car, it’s an unknown. Substitutes end up dinging a car for a body panel alignment as much as a transmission replacement.

Re:What Happened to Wirecutter? by rootusrootus on Wednesday August 23, 2023 @10:07AM (#37236131)
For anyone interested, CR has a write-up on how they test toilet flushing:

https://www.consumerreports.org/toilets/what-happens-when-co...

Re:What Happened to Wirecutter? by jstarfish on Wednesday August 23, 2023 @01:40PM (#37239522)
> to test that you gotta poop in them and that’s hard to reproduce scientifically. So weird substitutes like golf balls and whatnot are used instead.

Nah, just bring in some large dogs. You'll never be without mighty turds to dispose of.

Beyond that, entire rolls of toilet paper, socks, makeup cassettes, cigarettes, toy cars, bleach wipes, pads, tampons (with and without plastic applicators) and other nonfecal items are the things you should be testing your toilet with, since those are what will go down your pipe in production.

My FIL is the type to insist on buying whichever toilet can suck down the most golf balls. Pooping at his house means never having to sheepishly ask for a plunger. His is like an airplane toilet.

Re:What Happened to Wirecutter? by wolverine876 on Wednesday August 23, 2023 @01:32AM (#37232208)
> Consumer reports at least is known to be gamed

I haven't heard of that. Could you tell us what you're referring to?

> and they have specific review methodology you need to understand and interpret

I've ready many Consumer Reports reviews; I don't know what this comment refers to. The style of the graphics in their tables?

Their methodology is simply scientific method.

Re:What Happened to Wirecutter? by bombcar on Wednesday August 23, 2023 @06:44AM (#37234011)
The one I know best is the toilets, as the “scientific method” has nothing to do with actually using the toilet to eliminate human waste.

And since the testing is known and not realistic, manufacturers can build for the test.

https://seclists.org/politech/2000/Mar/73

You have to understand their methodology because they may be ascribing “points” to things you don’t care about at all - especially if you’re looking for longevity.

Re:What Happened to Wirecutter? by wolverine876 on Wednesday August 23, 2023 @04:46PM (#37241679)
> https://seclists.org/politech/2000/Mar/73

The link is a random Internet person's post from 2000 about a single 1995 Consumer Reports review.

> You have to understand their methodology because they may be ascribing “points” to things you don’t care about at all - especially if you’re looking for longevity.

Every review everywhere, unless I hire the reviewer personally, will examine factors I am more and factors I am less interested in. They can't simultaneously, precisely serve everyone's varied interests (ok, I guess they could try some social media feed-type algorithm).

> the “scientific method” has nothing to do with actually using the toilet to eliminate human waste.

That's confusing. The scientific method is to actually do it and report what happens, not talk theoretically or speculatively about it from our basements like the rest of the Internet. CR generally does that (the scientific method) in extensive labs, staffed with experienced scientists and engineers. If you read their toilet reviews, that's what they do - put something in and flush. CR's core product is science, applied to consumer products.

> especially if you’re looking for longevity.

CR looks at longevity for many products, including extensive surveys of product owners.

Re:What Happened to Wirecutter? by zoltar on Tuesday August 22, 2023 @11:40PM (#37231584)
I've found smaller categories of products with decent reviews on youtube. Project Farm and America's Test Kitchen spring to mind. I'm not sure they're as rigorous, but it's beyond what I'm willing to do at home by myself.
Re:What Happened to Wirecutter? by Baeocystin on Tuesday August 22, 2023 @11:58PM (#37231686)
I wish other YouTubers would take note of the information density that Project Farm packs in to his videos. It's really something else.
Re:What Happened to Wirecutter? by lars_francke on Wednesday August 23, 2023 @01:50AM (#37232288)
Similar organizations exist in other countries as well

https://en.wikipedia.org/wiki/Stiftung_Warentest

https://en.wikipedia.org/wiki/International_Consumer_Researc...

I'm subscribed to the former but I found that at least some of my circle of friends and family don't like their reviews because they don't focus on things like "coolness" or aesthetics. Instead they take into account things like safety, labeling and other things.

Re:What Happened to Wirecutter? by yread on Wednesday August 23, 2023 @02:38AM (#37232527)
wow that's a lot. It would be cool if signing up for one would give you access to reviews from the other ones too.
Re:What Happened to Wirecutter? by IndySun on Wednesday August 23, 2023 @02:06AM (#37232363)
A family member has which.co.uk and I find its marking system wildly inconsistent. A good battery life marked well on several products can arbitrarily lift one of those products to the top for example... and as such I don't read it anymore. And secondly, and this is common across all such review sites and comments, is that you suddenly discover how much bumpf is being written when you happen upon a review for a product or department you own or know well.
Re:What Happened to Wirecutter? by tomcam on Tuesday August 22, 2023 @11:01PM (#37231378)
The big question is, how would good reviewers get paid? Affiliate relationships are a conflict of interest, but people won’t pay for reviews.
Re:What Happened to Wirecutter? by sanderjd on Tuesday August 22, 2023 @11:08PM (#37231422)
Being a component of a popular media subscription bundle ... like the New York Times. That seems like the right model to me.
Re:What Happened to Wirecutter? by throw9away6 on Tuesday August 22, 2023 @11:10PM (#37231438)
Nobody really needs reviews of shitty products. A review site really only needs to write long form reviews of products they recommend due to quality or value. The affiliate stuff then really isn’t that much of a conflict if every product provides equal revenue.
Re:What Happened to Wirecutter? by tomcam on Wednesday August 23, 2023 @06:50AM (#37234041)
Well yeah but… a lot of the time you don’t know up front that something is shitty, right?
Re:What Happened to Wirecutter? by Given_47 on Thursday August 24, 2023 @01:35AM (#37245379)
> every product provides equal revenue

Though I’d imagine most places have differing affiliate structures depending on the brand

Re:What Happened to Wirecutter? by frognumber on Wednesday August 23, 2023 @12:05AM (#37231742)
A lot of people DO pay for reviews. Consumer Reports is an example.

It's also possible to do transparent governance and have firewalls between reviewers and monatization. Few do, but it's a good idea.

Re:What Happened to Wirecutter? by tomcam on Wednesday August 23, 2023 @06:51AM (#37234047)
Consumer Reports appears to be a shell of its former self though.

I like the firewall idea a lot but modern media are so lacking in credibility that I’m not convinced it would work.

Re:What Happened to Wirecutter? by rodgerd on Wednesday August 23, 2023 @12:23AM (#37231857)
The Consumers' Institute of New Zealand has people sign up for membership, and that funds their reviewing and advocacy. I think that models like that, co-ops, and the like are the only real way to make it work.

As soon as your reviews run on advertising, affiliate links, whatever, you've immediately got pressure to be mindful of revenue streams.

Re:What Happened to Wirecutter? by patmcc on Wednesday August 23, 2023 @02:33AM (#37232497)
I think part of why I used to trust Wirecutter was all the links (that I saw, at the time) were just Amazon Affiliates - it mitigated the conflict of interest if I knew whichever of the 8 headphones I buy they're getting the same cut from Amazon. Why would they lie about which is best?

But then with per-brand affiliate deals, yeah, I'm much more suspicious.

Re:What Happened to Wirecutter? by KingMob on Wednesday August 23, 2023 @03:41AM (#37232929)
> Why would they lie about which is best?

If the affiliate cut was a percentage they have an incentive to recommend pricier options (assuming they can't predict the price-volume tradeoff of their readers). If the affiliate is a flat fee per item, they have an incentive to recommend cheaper options, so more people buy. And in either case, they have a disincentive not to recommend a category at all.

None of these are complete trust-killers, I'm just pointing out that getting paid out by Amazon instead of the brands doesn't eliminate incentives. All it does is ensure any incentive is consistent.

Re:What Happened to Wirecutter? by daft_pink on Wednesday August 23, 2023 @02:58PM (#37240608)
I agree. I often wondered if they recommended pricier products before, because some things I bought were expensive.

However, when they just were through amazon, they didn't have to have conversations with the company to get a commission.

What happens if they test something and it's great, and the company making the great product refuses to give them a commission?

If something is a good deal for them, will they not update the review, because the affiliate setup is making a lot of money and they don't want to adjust it?

What happens if they don't like the affiliate system the company's website uses, because it doesn't track cookies well enough? Do they have to call the company after the test and have them setup a specific affiliate system?

It just seems like a terrible idea and there all these conflicts when they are negotiating a side deal with the company they review vs just collecting a consistent cut from a large marketplace like amazon.

Re:What Happened to Wirecutter? by thrashh on Tuesday August 22, 2023 @11:44PM (#37231603)
I used to think they were good but I think they were only good on paper, even before they were bought by NYT.

I checked out a lot of their top picks and a lot of them had like 2/5 ratings after a few years and it turns out a lot of their picks weren’t really reliable or weren’t that good once you used it a lot.

I feel like Wirecutter just bought a bunch of stuff and compared things superficially.

Re:What Happened to Wirecutter? by Baeocystin on Tuesday August 22, 2023 @11:56PM (#37231672)
I only read Wirecutter when Ars Technica would host their occasional article, and came to the same conclusion as you. Any time they covered something that I had experience with, it was painfully obvious that they had barely used the damn thing. If you were in to their house style, they picked things that fit in that sense, but a solid meh for the review side of things.
Re:What Happened to Wirecutter? by joshstrange on Wednesday August 23, 2023 @09:46AM (#37235764)
> I checked out a lot of their top picks and a lot of them had like 2/5 ratings after a few years and it turns out a lot of their picks weren’t really reliable or weren’t that good once you used it a lot.

The other thing that happened more than few times is once the product got reviewed the producer would cut corners and start shipping a vastly inferior product since they knew they could coast on the WC recommendation and increase their profit margin even further. I'm sure some of the corner-cutting was due to increased sales (not necessarily malicious) but a lot of it seemed to come 100% from greed.

Re:What Happened to Wirecutter? by LorenPechtel on Wednesday August 23, 2023 @01:15PM (#37239142)
It's very hard to test durability.
Re:What Happened to Wirecutter? by firecall on Wednesday August 23, 2023 @01:51AM (#37232291)
They don't seem to get surfaced in Google anymore either. At least, not for me over here in Australia!

Haven't looked at Wirecutter in the longest time!

Re:What Happened to Wirecutter? by lhl on Wednesday August 23, 2023 @01:54AM (#37232307)
I dunno, I gave up on Wirecutter for anything I actually cared about almost 10 years ago - I found that for anything that I had actually done even basic research on, the Wirecutter was always wrong (and not just like sort of wrong, but like completely missing the point/out to lunch wrong): https://randomfoo.net/2014/03/22/the-wirecutter-is-always-wr...