News for hackers. Stuff that matters.
Re:The control group is out of control (2014) by nathanwh on Saturday January 22, 2022 @02:23PM (#30039940)
Honestly this XKCD arguing that psychic phenomena don't exist because they're not exploited for profit is a comforting difficult to refute argument for me: https://xkcd.com/808/
Re:The control group is out of control (2014) by normac2 on Saturday January 22, 2022 @04:04PM (#30040810)
The author of this blog, Scott Alexander, has an online novel called Unsong [1] based on this idea. In the book's universe, Kaballah is real and (among many other wild things) corporations automatically generate long lists of Hebrew characters to find names of God that give various powers.

[1] https://unsongbook.com/

Re:The control group is out of control (2014) by csdvrx on Saturday January 22, 2022 @06:57PM (#30042143)
> In the book's universe, Kaballah is real and (among many other wild things) corporations automatically generate long lists of Hebrew characters to find names of God that give various powers.

In this universe, we do the same with numbers generated by ASICS or GPU: it mostly gives the power of money.

Re:The control group is out of control (2014) by jacquesm on Saturday January 22, 2022 @09:06PM (#30042952)
There is that sf story about the names of god too:

https://en.wikipedia.org/wiki/The_Nine_Billion_Names_of_God

Re:The control group is out of control (2014) by NateEag on Saturday January 22, 2022 @02:36PM (#30040061)
It may be that psychic powers exist but that they are not powerful, general, or controllable enough to be reliably profitable.

Also, if every profitable phenomenon in the world is already developed, then no business should ever invest in fundamental research - i.e., the pharmaceutical companies are wasting their research dollars.

Why is it comforting to you to believe psychic powers don't exist?

Re:The control group is out of control (2014) by gs17 on Saturday January 22, 2022 @03:38PM (#30040607)
Yeah, e.g. someone who can, for example, consistently predict single bits of output from true random number generators 51% of the time would be evidence of something very strange going on, but not necessarily usable for anything practical. (Maybe if you could gather enough of these people to overcome the "weak" ability?)
Re:The control group is out of control (2014) by mathattack on Saturday January 22, 2022 @04:41PM (#30041101)
If you could consistently predict stock moves 51% of the time eventually you’d have all the money in the universe.
Re:The control group is out of control (2014) by gs17 on Saturday January 22, 2022 @07:03PM (#30042197)
Fair point, maybe it applies more to categories like dowsing, where doing marginally better than chance (or general unaided human ability to detect whatever) would have huge implications, but might not be profitable to employ when compared to modern technological methods, and definitely doesn't allow for easy reinvestment. Who wants to rely on a dowser who is wrong often and can't explain why when you could have a geological survey done that's more reliable and explainable?
Re:The control group is out of control (2014) by hooande on Sunday January 23, 2022 @01:01AM (#30043982)
what's the point in a dowser that's wrong often? isn't that like having a "slightly better than chance" super power? ie, can't fly but can jump higher than average (some times)
Re:The control group is out of control (2014) by NateEag on Sunday January 23, 2022 @09:50AM (#30046512)
Yes, exactly.

Just because something isn't particularly useful doesn't mean it cannot exist.

Re:The control group is out of control (2014) by sokoloff on Saturday January 22, 2022 @05:01PM (#30041236)
It depends on what you mean by 51% of the time. If you’re just making a directional prediction, “will the next market day be up or down?”, that’s nowhere near enough.

A little over 53% of days are up (green) days and yet you can’t use that 3x edge over a 51% predictor to make all the money.

Re:The control group is out of control (2014) by ajuc on Saturday January 22, 2022 @05:36PM (#30041513)
Try "will the X go up or down next second".

> A little over 53% of days are up (green) days and yet you can’t use that 3x edge over a 51% predictor to make all the money.

You can make money, just not ALL the money. And that's because other people know that too.

Re:The control group is out of control (2014) by sokoloff on Saturday January 22, 2022 @07:13PM (#30042260)
I don’t have access to tick-by-tick feeds any more to test this, but I’d predict that “X will go up or down next second, [ignoring UNCHs]?” is predicted more than 51% of the time by predicting the same trend as the current/previous second and that you’re going to win on percentage of guesses and lose on money (because the changes in direction seconds [where your guess is wrong] are higher vol than the trend continuation seconds).
Re:The control group is out of control (2014) by ajuc on Wednesday January 26, 2022 @03:39AM (#30083187)
Again the difference is that everybody (who cares enough) know about the trends, but only you know about the 51% predictions.

Assuming these information sources are independent - even if the trends predicted the market in 99% and your prediction was only 51% - you can still combine them to get a better estimate than the generally known one.

Re:The control group is out of control (2014) by SilasX on Saturday January 22, 2022 @05:53PM (#30041629)
Wait, what? I don’t have a specific cite, but I thought that predicting a random number generator that well is good enough to break common crypto algorithms?

IIRC, doing better than chance by 2^-32 is enough for the randomization system to be thrown out, and marching the output 51% is way better than that.

But yes, I’d agree with a steelmanned version of your point with a much smaller improvement over chance. But then, you would have to do a realllllly long test and it wouldn’t actually look that impressive.

Re:The control group is out of control (2014) by gs17 on Saturday January 22, 2022 @06:37PM (#30041988)
Thanks, replace 51% with (50 + small non zero)%, anything more than chance, assuming the RNG has no bias to exploit, is "doing the impossible" but not necessarily feasible to profit off of.
Re:The control group is out of control (2014) by SilasX on Sunday January 23, 2022 @06:34AM (#30045423)
Hence my last paragraph: that would mean that psychic powers aren’t all that impressive and just have effects on the 32nd most significant bit.
Re:The control group is out of control (2014) by prionassembly on Saturday January 22, 2022 @04:26PM (#30040982)
AdaBoost, etc. were invented precisely to make good use of weak predictors.
Re:The control group is out of control (2014) by sampo on Saturday January 22, 2022 @06:42PM (#30042031)
Also, certain supernatural abilities would have been so useful in stone age societies that they would have given an evolutionary advantage to the individuals possessing them, and hence we all should have those abilities by now, as evolution should have made those adaptations more common.
Re:The control group is out of control (2014) by optimalsolver on Saturday January 22, 2022 @07:36PM (#30042420)
In Larry Niven's "Known Space" books [0], there was a planet where telepathy was common. Natural selection kept it in check so a hunter would only be able to nudge a prey into walking into an ambush. Then an alien exploratory vessel lands on the planet, aliens that have no resistance to telepathy are instantly controlled and you get an intergalactic slaver empire from a neolithic culture in one generation.

So red queen effect [1]. Maybe telepathy evolves in tandem with resistance to telepathy.

[0] https://en.wikipedia.org/wiki/World_of_Ptavvs

[1] https://en.wikipedia.org/wiki/Red_Queen's_race

Re:The control group is out of control (2014) by HWR_14 on Saturday January 22, 2022 @03:03PM (#30040325)
You don't know if people are using them for profit. Are the best surgeons guided by auras or do Oil companies use divinations?
Re:The control group is out of control (2014) by astrange on Saturday January 22, 2022 @07:46PM (#30042493)
Oil/mining companies have definitely used dowsing in the past, but as far as I know it didn’t work.
Re:The control group is out of control (2014) by bshepard on Saturday January 22, 2022 @03:16PM (#30040442)
Just because a phenomenon can't be industrialized doesn't mean it doesn't exist; you can't industrialize lyric poetry, for example.
Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @03:35PM (#30040580)
The phenomena discussed in that comic were chosen for inclusion specifically because they actually would lend themselves quite easily and obviously to commercial exploitation if they really existed as popularly conceived. If you stipulate that all of those alleged psychic phenomena are inherently not exploitable in those ways or any other significantly profitable way, you're basically redefining those terms contrary to their popular meanings and just moving the goalposts.
Re:The control group is out of control (2014) by PaulDavisThe1st on Saturday January 22, 2022 @04:18PM (#30040912)
The same could be said of antibiotics. However, before Ehrlich & Pasteur, there were no large scale use or even specific awareness of the concept (i.e. some cultures had folk medicinal remedies that involved antibiotics but the mechanism and specific compounds were not understood).

So until the 1880s, there was no commercial exploitation of these compounds, yet they nevertheless existed either in actuality or potential. Once there was an understanding of the principles and the development of some related chemical and biochemical processing, this exploded and had a dramatic impact on human life.

If someone postulated in, say, 1785, the idea that perhaps there were specific compounds that could be used to cure infection, and these could be produced en masse, would it not be analogous to respond that since nobody is commercially exploiting (at the time), they clearly do not exist?

Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @04:36PM (#30041058)
> If someone postulated in, say, 1785, the idea that perhaps there were specific compounds that could be used to cure infection, and these could be produced en masse, would it not be analogous to respond that since nobody is commercially exploiting (at the time), they clearly do not exist?

None of the ideas included in the xkcd comic are particularly new or obscure. Despite being pigeonholed as a certain kind of bullshit, they are still ideas that a lot of people have heard about and been hearing about for a very long time—more than enough time for someone to get around to commercially exploiting if that were in fact practical. Ghostbusters came out 37 years ago, and the stuff it made fun of was familiar enough to its audience.

However, in 1785 the principles of chemical engineering were largely unknown, precluding the development of a modern-style pharmaceutical industry. It did not, however, prevent widespread use of antibiotic treatments that we now understand the mechanism for and can refine or synthesize into more effective forms.

Re:The control group is out of control (2014) by PaulDavisThe1st on Saturday January 22, 2022 @08:26PM (#30042734)
Entirely fair.
Re:The control group is out of control (2014) by bshepard on Saturday January 22, 2022 @04:19PM (#30040928)
(1) All of these practices depend on cultivating virtues that are contradictory to industrialization/capitalization: just as lyric poetry is.

(2) It is intriguing to consider commercial music as an industrial utilization of lyric poetry, but the point is that the individual activity of lyric poetry is not amenable to industrialization IN ITSELF, but it still exists. But perhaps this example doesn't work -- the really important argument is above, namely, that the cultivation of these practices -- astrology, dousing, etc, is individuated, and oriented around virtues directly opposed to their mass utilization.

(3) As other commentators have noticed, we also don't know that these sciences aren't used on a mass technological/industrial fashion --- it seems likely, for instance, that there are corporate entities that use i ching divination, and likely, too, that there are financial firms that utilize astrological methods -- but wouldn't reveal this because of the likely opprobrium from a still dominant (if clearly declining) orthodox materialism...

Re:The control group is out of control (2014) by itronitron on Saturday January 22, 2022 @03:57PM (#30040749)
The parent comment didn't mention industrializing it but rather turning a profit, and many recording artists have profited from their lyric poetry.
Re:The control group is out of control (2014) by Stupulous on Saturday January 22, 2022 @05:10PM (#30041303)
Many self-proclaimed psychics have made a good amount of money in the practice as well.
Re:The control group is out of control (2014) by SilasX on Sunday January 23, 2022 @06:36AM (#30045430)
That’s because poetry’s success is a function of social consensus rather than objective reality. But anything that depends on something real can be industrialized.
Re:The control group is out of control (2014) by kragen on Saturday January 22, 2022 @03:31PM (#30040537)
RCA did.
Re:The control group is out of control (2014) by jpttsn on Saturday January 22, 2022 @03:57PM (#30040747)
What if in the time before the discovery of e.g. quantum mechanics you did the same analysis? Would it tell you that quantum mechanics doesn’t exist?
Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @04:07PM (#30040838)
If you don't have a theory of quantum mechanics and you don't have any observable phenomena that require a quantum explanation, then there's nothing to apply this kind of analysis to, and nothing to reject the existence of.
Re:The control group is out of control (2014) by theptip on Saturday January 22, 2022 @02:48PM (#30040183)
It’s a sound point. Even a very small edge in precognition or mind reading (no matter how unreliable) would allow hedge funds to beat the market and make a killing. Ergo these effects do not exist because nobody is doing this.
Re:The control group is out of control (2014) by HWR_14 on Saturday January 22, 2022 @03:04PM (#30040339)
Mind reading doesn't seem terribly useful if it is in a relatively small radius.

But you could do that, or just make enough money gambling in poker rooms and racetracks.

Hell, if you could see a few days into the future, it might be smartest to just break that out when the lottery gets big enough one time.

Re:The control group is out of control (2014) by q-big on Saturday January 22, 2022 @03:33PM (#30040562)
> Even a very small edge in precognition or mind reading (no matter how unreliable) would allow hedge funds to beat the market and make a killing. Ergo these effects do not exist because nobody is doing this.

It is known that many people who consider that they might have psychic powers are on the highly sensitive side.

Knowing people who are highly sensitive, I can easily imagine that the enormous stress, pressure and greed in a hedge fund environment would make hedge funds a horrible work environment for such people.

Re:The control group is out of control (2014) by nradov on Saturday January 22, 2022 @02:58PM (#30040270)
Just to play devil's advocate, how do you know they're not? A psychic hedge fund manager wouldn't necessarily reveal their secret.
Re:The control group is out of control (2014) by theptip on Saturday January 22, 2022 @05:42PM (#30041555)
A single psychic hedge fund manager wouldn't reveal themselves, but as an industry if you're trying to hire psychics it would not be possible to keep this fact secret.
Re:The control group is out of control (2014) by alar44 on Saturday January 22, 2022 @03:18PM (#30040452)
Because hedge funds don't beat the market for more than a year or two at a time, no one does. It's all a scam. Nothing beats just holding index funds.
Re:The control group is out of control (2014) by CrazyStat on Saturday January 22, 2022 @04:05PM (#30040820)
Renaissance's Medallion fund, net fees, has beat the market almost every year since 1990. Twice by more than 100 percentage points.

Maybe Simons is psychic and all the quant stuff is just a coverup.

Re:The control group is out of control (2014) by astrange on Saturday January 22, 2022 @07:50PM (#30042517)
If you fail too hard at investing you have to quit, but if you’re too successful you also quit because you retire or the technique doesn’t work for too large a fund.

Note, “just hold index funds” as a strategy should be dominated by “borrow a lot of money and put it in index funds” by the same arguments. Don’t see robos offering that though.

Re:The control group is out of control (2014) by aradox66 on Saturday January 22, 2022 @04:49PM (#30041149)
That's only true on average.
Re:The control group is out of control (2014) by rkk3 on Saturday January 22, 2022 @02:56PM (#30040248)
Hedge funds do beat the market, individually. Steve Cohen probably has psychic powers.
Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @03:21PM (#30040474)
> Steve Cohen probably has psychic powers.

What about his track record cannot be adequately explained by mundane insider trading?

Edit: Puzzled by the downvotes. I think it's entirely fair to ask whether Cohen is enough of an outlier that it requires a psychic explanation, even after accounting for the degree of success that can be reasonably attributed to luck and non-psychic skill (effects which other hedge fund managers are also subject to) plus the insider trading he's been involved in (which other hedge fund managers are not necessarily subject to).

In a world with a finite number of hedge fund managers, there is always going to be somebody who is the most successful out of the bunch, and that somebody is almost certainly going to appear to be an outlier even without a supernatural influence on their success. So before attributing anything to psychic powers, we first have to establish whether he's too successful to be accounted for by the non-psychic explanations. I genuinely don't know enough about Steve Cohen's track record to know whether he's that much of an outlier, and I'd appreciate some real information about the degree of his success rather than just downvoting.

Re:The control group is out of control (2014) by mistermann on Saturday January 22, 2022 @02:55PM (#30040245)
Actually this only shows that this specific form does not exist, or has not been discovered, or possibly something else both of us have overlooked.
Re:The control group is out of control (2014) by blendergeek on Sunday January 23, 2022 @02:15AM (#30044288)
Some hedge funds do make a killing.

You can't prove they aren't using paranormal powers.

Ergo the case isn't closed yet.

Re:The control group is out of control (2014) by tsol on Saturday January 22, 2022 @08:56PM (#30042906)
Warren Buffet has done quite well. So maybe it exists but only one person in the world is capable of it.
Re:The control group is out of control (2014) by TigeriusKirk on Saturday January 22, 2022 @02:46PM (#30040166)
How do you know the things the chart says aren't happening really aren't happening?
Re:The control group is out of control (2014) by Groxx on Saturday January 22, 2022 @03:09PM (#30040389)
Astrology, Tarot, and many similar things are absolutely used by people in financial planning, yeah. And on the more "acceptable" and orders of magnitude more people side of things, just look at "lucky x" with lottery purchases.

But that's still a LOT less profit exploitation than e.g. GPS which is ubiquitous. Curses haven't replaced drones in the military. Crystals aren't in billions of electronic devices wait

Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @02:58PM (#30040268)
There would be evidence. The chart helpfully points out a specific kind of evidence that is more or less impossible to conceal with any kind of conspiracy.
Re:The control group is out of control (2014) by Izkata on Saturday January 22, 2022 @03:05PM (#30040353)
One kind of possible evidence.

A flipside example: Financial world could instead be used by individuals on casinos, betting, stock markets, etc. and they'd have incentive to keep it secret so they keep winning.

Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @03:15PM (#30040433)
It might be plausible to assume that someone exploiting ESP or whatever to beat the house could keep the secret of how they're winning. But it's a lot less plausible to postulate that they could keep secret the fact that they are beating the house or beating the market, unless the effect size is too small to be of much interest in the first place (ie. you have to largely abandon part of the original hypothesis: that the crazy phenomenon actually works).
Re:The control group is out of control (2014) by yosamino on Saturday January 22, 2022 @03:18PM (#30040457)
This argument has the structure of a conspiracy theory: "A small group of people being able to keep an enormous secret, in order to manipulate the rest of us."

The more enormous the secret and the larger the group of people who supposedly are in on it, the more the probability of the secret not being a secret very long approaches one.

I find it very unlikely that a shortcut to making a lot of money would be secret for very long.

Re:The control group is out of control (2014) by wtallis on Saturday January 22, 2022 @03:27PM (#30040508)
In particular, as the scope of the conspiracy grows, the cost of keeping that secret very quickly outstrips any potential profit from exploiting the secret. Eg. if oil companies could use ESP to know where to drill, then they would still need to be spending large sums of money on computers and software to analyze seismic data, or else the collapse of demand for those products would expose the conspiracy.
Re:The control group is out of control (2014) by hirako2000 on Saturday January 22, 2022 @05:03PM (#30041250)
no planned obsolescence took place for a number of consumer products.

multiple and costly military invasions were to offer democracy as goodwill and for world safety.

a certain vaccine I can't dare to name is a vaccine as it does provide immunity.

the institutions of most democracies surely can't be so corrupted.

worldwide cocoa isn't mostly harvested by enslaved workers.

HIV is so far more prevalent in Africa because they can't afford treatment and understand prevention measures there.

JFK.

I could go on and on but not sure how many examples you would need to accept that the chances for enormous secrets known by even a significantly large group to not take a freaking long time before blowing up is rather close to zero. thus reconsidering your opinion on the existence of conspiracies.

and, about shortcuts to making a lot of money being kept rather well secrets: dark budgets, secret and hidden inflation, supply fudging

Re:The control group is out of control (2014) by yosamino on Saturday January 22, 2022 @07:38PM (#30042434)
A critique of conspiracy theories is not a denial that conspiracies exist. It just means that the concept of a "conspiracy theory" as basis of trying to understand reality is flawed, because it relies on no or bad evidence, and very often seeks to simplify a very complex reality in a way that doesn't do that reality justice.

But I am not sure if we both mean the same things when we use the word "conspiracy". It's not a secret, for example. that cocolate has a slave labor problem. Planned obsolescence is not a secret (but it's more complex than just someone trying to screw you over). I don't think I understand the conspiracy aspect of the rest of your examples, save for the obvious JFK conspiracy theories.

> about shortcuts to making a lot of money being kept rather well secrets: dark budgets, secret and hidden inflation, supply fudging

I would put to you: If the chances of this blowing up is rather close to zero, how do you know about it ?

Re:The control group is out of control (2014) by hirako2000 on Sunday January 23, 2022 @12:59AM (#30043972)
definist fallacy or persuasive definition, not sure which argumentative trickery you are using right there with your selected definition of conspiracy theory critique.

what is more straight to see is that you've just made a false attribution by distorting what I wrote about close to zero chances of a blow up. I don't question your intention and honesty, but read my comment more carefully, or quote verbatim without distortion, and resist the use of fallacies in general if you would like to engage in honest and fair argumentative discution.

planned obsolescence was a well kept from public industrial scheme, decided by a small group, screwing billions of consumers. it isn't a secret anymore, it blew up, it took several decades to blow up, kept being refuted by some who haven't caught up with the evidences.

and if you accept the JFK case then I suppose you are admitting to beleive in some conspiracies, while at the same time refuting the concept while it's enduring its long process of battle against deniers, during the inevitable period of evidences remaining arguably to few or too weak, simplifications of reality. consider at least accepting there is some contradiction this logic.

edit: had pressed send before finishing the comment.

Re:The control group is out of control (2014) by mathattack on Saturday January 22, 2022 @04:37PM (#30041072)
Yes. The existence of casinos disproves psychic powers.
Re:The control group is out of control (2014) by throwaway7033 on Saturday January 22, 2022 @06:04PM (#30041724)
How so? Casinos routinely ban card counters; if psychic powers existed then psychics would also be banned from casinos.
Re:The control group is out of control (2014) by mathattack on Saturday January 22, 2022 @09:31PM (#30043064)
Identifying card counters is easier than identifying psychics.
Re:The control group is out of control (2014) by nestorD on Saturday January 22, 2022 @06:18PM (#30041825)
I am seing one empty box that should get a "has been tried" mark and four that should get "are being used" marks. I don't know if they work but I know they are being used for profit.
Re:The control group is out of control (2014) by bsder on Saturday January 22, 2022 @08:33PM (#30042767)
Actually, you find aromatherapy and its ilk used in healthcare.

It seems to help people relax going into surgery and improves outcomes.

Thus strengthening your argument that if it works, capitalism will exploit it.