News for hackers. Stuff that matters.
Re:“The Pirate Bay can’t be stopped,” co-founder says by dane-pgp on Sunday November 28, 2021 @03:12PM (#29372475)
> There was language that might have implied this was the case, but it was not clear or I was oblivious, probably the latter.

For what it's worth, the language and layout was probably A/B tested and painstakingly tuned to maximise the probability of you making that mistake. Don't blame yourself when there's this unfair power imbalance, blame them for using their power against you maliciously.

Re:“The Pirate Bay can’t be stopped,” co-founder says by PaulDavisThe1st on Sunday November 28, 2021 @04:08PM (#29373045)
> For what it's worth, the language and layout was probably A/B tested and painstakingly tuned to maximise the probability

This sort of belief (that corporations do extensive testing and tuning of language) seems quite widely held, but I've never seen much support for it.

I've frequently seen claims that Amazon must have "A/B tested and painstakingly tuned" the company name, whereas it was really just the founder's whim after watching a documentary, and never received any testing of any kind.

Re:“The Pirate Bay can’t be stopped,” co-founder says by rp1 on Sunday November 28, 2021 @04:24PM (#29373188)
Have you ever worked at a large corporation like Facebook or Amazon? They have extensive internal A/B testing frameworks that record a wide variety of user metrics for arbitrary control and treatment exposures. It's very easy to set up an A/B test and pretty much necessary for almost all changes. Additionally, employees are expected to have concrete artifacts when they go up for promotion, and A/B test results are often a large part of that.
Re:“The Pirate Bay can’t be stopped,” co-founder says by PaulDavisThe1st on Sunday November 28, 2021 @05:10PM (#29373571)
> Have you ever worked at a large corporation like Facebook or Amazon?

Employee #2 at amzn.

But sure, that doesn't count because I got out before the company hit 20 employees.

I don't doubt that large corporations with heavy technology dependence engage in what you're describing to cover some aspects of their operations. I do doubt that is covers all aspects, and in particular, I very much doubt if amzn A/B tested the language described in the GP for the purposes claimed by the parent of my comment.

EDIT: Given the comment @ https://news.ycombinator.com/item?id=29374358 I should probably just accept that for amzn at least, I'm just wrong.

Re:“The Pirate Bay can’t be stopped,” co-founder says by rp1 on Sunday November 28, 2021 @05:33PM (#29373818)
That's pretty impressive! Having worked at Amazon much later, I do think that most copy changes do go through an A/B test. I remember an instance where we tested 20 different versions of a minor UI change. Interestingly, there was a wide spread in the performance of the different treatments.
Re:“The Pirate Bay can’t be stopped,” co-founder says by vhgyu75e6u on Sunday November 28, 2021 @06:26PM (#29374358)
Current amzn employee working on the retail website. Unless a team is jumping/ignoring all standard operation precedures, everything must go through an A/B test to prove that it works at increasing the revenue or whatever the KPI target is. This includes text that might need to go through legal in some cases
Re:“The Pirate Bay can’t be stopped,” co-founder says by PaulDavisThe1st on Sunday November 28, 2021 @06:53PM (#29374580)
Fair enough then. I'm wrong, for amzn anyway.
Re:“The Pirate Bay can’t be stopped,” co-founder says by version_five on Sunday November 28, 2021 @07:21PM (#29374802)
I think to some extent you and the original post you replied to are both probably right.

There is not some painstaking language optimization designed to trick users. But there is not a filter for clarity either, so the A/B testing naturally favors "dark patterns" - it's not malicious design, it's just unintended consequences, and gives the impression that Amazon et al are deliberately hostile when they are really just ignorant

Re:“The Pirate Bay can’t be stopped,” co-founder says by stcredzero on Sunday November 28, 2021 @08:01PM (#29375101)
the A/B testing naturally favors "dark patterns" - it's not malicious design, it's just unintended consequences

Could there be such a thing as "meta-malicious design?" Bad consequences aren't executed directly, but conditions are put in place that cause the emergence of bad consequences.

I suspect, if AI ever does away with Homo sapiens it will be by convincing us not to breed by changing our incentive structures.

Re:“The Pirate Bay can’t be stopped,” co-founder says by GekkePrutser on Sunday November 28, 2021 @11:11PM (#29376275)
> I suspect, if AI ever does away with Homo sapiens it will be by convincing us not to breed by changing our incentive structures.

I think it'll be by just sitting back and waiting a few decades :)

Re:“The Pirate Bay can’t be stopped,” co-founder says by stcredzero on Monday November 29, 2021 @01:09PM (#29383037)
I think it'll be by just sitting back and waiting a few decades :)

The sci-fi tinfoil hat interpretation of this: It's already here, or at least its cronies and enablers, and the plan has already been put into effect.

Re:“The Pirate Bay can’t be stopped,” co-founder says by teddyh on Monday November 29, 2021 @06:10AM (#29378458)
“Bad men need nothing more to compass their ends, than that good men should look on and do nothing.”

— John Stuart Mill, 1867

Re:“The Pirate Bay can’t be stopped,” co-founder says by stcredzero on Monday November 29, 2021 @01:07PM (#29383005)
I'm talking about the good people not even knowing what's happening, until they engage in data analysis.
Re:“The Pirate Bay can’t be stopped,” co-founder says by kingcharles on Tuesday November 30, 2021 @09:11PM (#29399863)
Also, humans are weird, so A/B testing, if taken to its logical conclusion, will produce surreal results. What makes a human buy something is really not that well understood, IMO.

For instance, I was in charge of design for a mortgage lender's web site. I begged my manager to let me try (for lulz) an A/B test replacing the photo of the woman call centre operator next to the quote form with a photo of a Labrador retriever wearing a headset (you knew he was a professional because he also wore glasses and a necktie). The dog form consistently outperformed the woman by 19% but we had to roll it back after a couple of weeks because.. well.. dog.

Re:“The Pirate Bay can’t be stopped,” co-founder says by random314 on Monday November 29, 2021 @01:34AM (#29377038)
It's TRUE for all large web tech companies. Everything is launched via A/B tests. Your performance evaluation as an engineer is dictated by how much your teams goal metrics moved thanks to your changes(impact measured by A/B tests).

At any given time, a single engineer might have a couple of A/B tests running. That's the single biggest engineering change I have seen in the last 20 years.

A/B tests are now crazy simple to set up; just click a few buttons and decide how much traffic to send. The major con is that it leaves a lot of dead code behind when the best of N A/B test arms are launched; the (N-1) unsuccessful arms stick around as dead code.

Re:“The Pirate Bay can’t be stopped,” co-founder says by vhgyu75e6u on Sunday November 28, 2021 @07:34PM (#29374906)
The other scenario is that that text is the first iteration and gave a positive KPI, if there are enough complains related to the structure of the text and is linked to increase in refunds, the team in charge would A/B another iteration targeting refund rate as KPI (although that might be difficult to correlate)
Re:“The Pirate Bay can’t be stopped,” co-founder says by puddingforears on Sunday November 28, 2021 @06:14PM (#29374238)
The last five companies I’ve worked for, three large, one tiny start up, and two msb’s, extensively used A/B and split testing to carefully fine tune every funnel and product to maximize conversion. Most of my job for the last decade has been moving split points around form flows and capturing metrics to show what caused a split to occur. I talk to less than more people that don’t use this practice.

I’ve run splits for everything from background colors to copy changes. If product management anticipates some facet could influence outcome, then it will be tested.

Re:“The Pirate Bay can’t be stopped,” co-founder says by anonymousab on Sunday November 28, 2021 @08:26PM (#29375248)
> This sort of belief (that corporations do extensive testing and tuning of language) seems quite widely held, but I've never seen much support for it.

I recall integrating with a beta AWS A/B testing sdk back in ~2015 (may be off on the year) and I'm certain that some the examples in the docs were along the lines of, say, testing two different wordings for a label in your app and measuring the change in engagement. But that's not inherently nefarious, it's just analytics. They ended up shutting down that SDK and the web dashboarding for it IIRC.

Now, A/B testing for the purpose of tuning languages towards deceptive dark patterns? It's harder to prove, but I think it follows that if they're A/B testing other changes, there's no reason that deceptive changes wouldn't also be A/B tested as a matter of course.

Re:“The Pirate Bay can’t be stopped,” co-founder says by tux3 on Sunday November 28, 2021 @04:10PM (#29373074)
Sometimes this happens as a sort of 'evolutionary' process. If a dodgy company has better wording for a misleading product, its deception will work better, so you can have highly tuned wording without anyone having to run an explicit A/B test.
Re:“The Pirate Bay can’t be stopped,” co-founder says by patcon on Sunday November 28, 2021 @06:44PM (#29374523)
Good point :) I'm glad to be reminded of that framing: a/b testing is just evolutionary selection within the same company-shaped container, but it's happening in the larger ecology even if you're not trying to run it.
Re:“The Pirate Bay can’t be stopped,” co-founder says by upbeat_general on Monday November 29, 2021 @12:54PM (#29382853)
I've personally worked at a large tech company and saw widespread A/B testing for things exactly as minute as this type of wording. It wasn't a constant dynamic A/B test that automatically selects the best results but rather a trial period and analysis for changes like this.

I obviously can't speak to this case in particular but for pieces of text that are part of the core user flow (not necessarily true in this case), I'd be shocked if A/B tests weren't going on at any large company.

Re:“The Pirate Bay can’t be stopped,” co-founder says by standardUser on Sunday November 28, 2021 @05:56PM (#29374061)
Even the small startups I have worked for A/B test everything they can within inches of its life to eke out an extra penny and a half. This is standard operating procedure.
Re:“The Pirate Bay can’t be stopped,” co-founder says by ericd on Sunday November 28, 2021 @06:24PM (#29374344)
Every time I've seen this (and I agree that it's ubiquitous), it seems to make a ton of work that could be much better spent on making a better product that people actually want to use.
Re:“The Pirate Bay can’t be stopped,” co-founder says by tata71 on Sunday November 28, 2021 @11:13PM (#29376282)
Bet your sweet ass they tested that smile in the logo.
Re:“The Pirate Bay can’t be stopped,” co-founder says by PaulDavisThe1st on Sunday November 28, 2021 @11:44PM (#29376471)
By the time they switched to that logo, they may have been large enough and "focused" enough to do so.

But the initial amzn logo was picked merely on the whims of the founder and first two programmers. It was never focus-grouped or evaluated by anyone else.