News for hackers. Stuff that matters.
Re:We think this cool study we found is flawed. Help us repr... by HWR_14 on Sunday May 01, 2022 @08:40AM (#31224544)
> It's always impossible to tell, for any given sequence, whether it was produced by a fair die. There's nothing an experimental subject can do to make the impossible more impossible.

That's just not true.

Or feel free to play a game with me. We'll roll a 20 sided die. If it comes up 20, you give me a ten. If it comes up any other number, I'll get you a dollar. Nice EV on that!

Oh, the die has come up 20, 20, 20, 20, 20, 20, 20 the last seven times. Do you play?

Re:We think this cool study we found is flawed. Help us repr... by geysersam on Sunday May 01, 2022 @08:58AM (#31224669)
It's just a question about what we perceive as random. It has nothing to do with the probability of the sequence being produced by a die, only with the probability of the sequence being produced by a human. A 20 20 20 sequence is not less random, it's just more likely to be produced by someone with incentive to cheat.

How did the researchers measure the "randomness" of a particular sequence in this experiment?

> Formally, the algorithmic (Kolmogorov-Chaitin) complexity of a string is the length of the shortest program that, running on a universal Turing machine (an abstract general-purpose computer), produces the string and halts.

Oh, interesting.

Re:We think this cool study we found is flawed. Help us repr... by dorgo on Sunday May 01, 2022 @10:54AM (#31225493)
I think we want (and expect) RNGs to produce sequences with high algorithmic complexity (which we regard as "random") and ignore the (almost impossible) possibility that they fail to do so.

An impossible to create modified RNG which always produces sequences with high algorithmic complexity would better meet our expectations of randomness, but would be less random because it could not produce uniform sequences (among others).

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Sunday May 01, 2022 @08:46AM (#31224590)
I would; would you? The Gambler's Paradox says you shouldn't (I'm assuming your 20-sided die isn't crooked).

Incidentally, you haven't made your case that you can ever tell whether a given sequence was produced by a fair die. You've just asserted it, and then suggested a game that doesn't illuminate anything.

Re:We think this cool study we found is flawed. Help us repr... by dtech on Sunday May 01, 2022 @09:03AM (#31224693)
It would be incredibly stupid to take the bet, as it's way more likely that the sequence was not produced by a fair die than that it was (i.e. the dice is rigged in the example)

Just because it's impossible to know for certain, doesn't mean you can't make a prediction with very high chance of being correct.

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Sunday May 01, 2022 @09:45AM (#31224966)
I'm not really a gambling man, but I'd expect a crooked 20-sided die to produce a biased sequence, not a running straight. I don't know if it's possible to make a die that always rolls the same, and I'd expect any such die to fail a superficial inspection (all sides but one bulge; one side is larger than the others; the die has a weird magnetic field; the die is heavily weighted on one side).

So I'd still expect a running straight to be rare, even with a crooked die.

Of course, if I watched the die produce 7 20s in a row, and was then asked to bet on the next roll NOT being 20, I'd be stupid to assume the die was fair without inspecting it.

All this is beside the point; the instructions invite the subject to produce a sequence that they think will convince people it was produced by a roll of dice. But there is no sequence that SHOULD have that power to convince.

Re:We think this cool study we found is flawed. Help us repr... by ByteJockey on Sunday May 01, 2022 @01:29PM (#31226842)
> I don't know if it's possible to make a die that always rolls the same

The easiest way would be to put the same number on every side, which would probably fail a superficial human inspection (but might pass a surprising number of machine inspections).

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Sunday May 01, 2022 @02:52PM (#31227602)
Hadn't thought of that!
Re:We think this cool study we found is flawed. Help us repr... by baobabKoodaa on Sunday May 01, 2022 @11:01AM (#31225561)
> All this is beside the point; the instructions invite the subject to produce a sequence that they think will convince people it was produced by a roll of dice. But there is no sequence that SHOULD have that power to convince.

If you genuinely believe that, we can easily set up a sequence of bets where you will win infinite amounts of money from me. But of course, you don't genuinely believe that, so you aren't interested in making bets around your supposed "beliefs".

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Sunday May 01, 2022 @02:51PM (#31227592)
I guess my "supposed" beliefs must be the beliefs you suppose I have. Whatever.

If you're offering me a bet, and you can easily set it up, then what bet are you proposing? You haven't been very specific. I'm no Turf Accountant[0], but I can spot a three-card-trick when I see one.

[0] https://en.wikipedia.org/w/index.php?title=Turf_accountant

Re:We think this cool study we found is flawed. Help us repr... by baobabKoodaa on Sunday May 01, 2022 @03:05PM (#31227709)
Fine. You made this statement:

> the instructions invite the subject to produce a sequence that they think will convince people it was produced by a roll of dice. But there is no sequence that SHOULD have that power to convince.

Let's gather a random sample of people 20 people. I will produce 10 manually generated sequences of dice rolls and 10 actual dice roll sequences. The sequences are added to a list and the list is shuffled. We will present each person with a sequence from the list (sampling without replacement), and the person should guess whether the sequence was manually generated or produced with a dice roll. For each person who correctly identifies a manual sequence as a manual sequence, I will pay you $1. For each person who mis-identifies a manual sequence as an actual dice-roll sequence, you will pay me $1000. As you said, you believe no sequence should have the power to convince a person of such a thing, you will obviously never have to actually pay me $1000, you would just collect 20 x $1 from me. I'd be happy to continue this up to infinity in batches of 20, so you will eventually get infinite dollars from me.

I will need escrow.

Re:We think this cool study we found is flawed. Help us repr... by a1369209993 on Sunday May 01, 2022 @03:29PM (#31227915)
> For each person who correctly identifies a []manual sequence[] as a manual sequence, I will pay you $1. For each person who mis-identifies a []manual sequence[] as an actual dice-roll sequence, you will pay me $1000.

Payment only happens for the manual sequences here.

> you would just collect 20 x $1 from me.

So they'd only get 10 x $1 per batch.

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Sunday May 01, 2022 @07:09PM (#31229632)
No bet!

You promised me "infinite amounts of money", I only stand to win 20 bucks.

Also, you have specified that these are 20 random people; so I guess I don't get to brief them in advance that they MUST say manual each time. So you have replaced me, the bettor, with a panel of 20 people whose average IQ is 100, and who don't have my interests at heart. Why would I take that bet?

If my random panel say manual each time, you stand to lose.

But as I say, I don't bet often. Only once a year, only on gee-gees, and only as much as I'm willing to lose (because I always lose).

Re:We think this cool study we found is flawed. Help us repr... by baobabKoodaa on Sunday May 01, 2022 @07:35PM (#31229769)
Look, you're merely pretending to disagree. You're pretending to believe something akin to "it's impossible to craft a sequence of numbers that convinces observes of its randomness". But you don't actually believe this [or whatever minor variation of that statement that you'd find agreeable in rhetoric]. If you did believe it, you would find a wager that we could do to settle this disagreement. But no such wager can possibly be formulated, because you don't actually believe what you pretend to believe.
Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Monday May 02, 2022 @02:49AM (#31232093)
It's not about my beliefs, except my belief that the die is fair.

I made a statement about a simple bet, using a fair 20-sided die, on the outcome of the 8th roll after the die has just come up 20 seven times. I'll take the bet that it doesn't come up 20 on the 8th roll. This scenario with 20 random people and 10 sequences appears to be a different scenario. I'm not sure how the odds work in that scenario, and I don't fancy that bet. That's all.

Re:We think this cool study we found is flawed. Help us repr... by baobabKoodaa on Monday May 02, 2022 @09:04AM (#31234626)
> I made a statement about a simple bet, using a fair 20-sided die, on the outcome of the 8th roll after the die has just come up 20 seven times. I'll take the bet that it doesn't come up 20 on the 8th roll.

How is this related to the topic at all? Our disagreement concerns the ability of humans to produce numbers that look random, our disagreement doesn't concern the ability of a fair die to produce numbers that look random. Of course a fair die is going to produce numbers that look random, that's not related to this discussion at all!

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Monday May 02, 2022 @11:41AM (#31236594)
It's related only to your challenge with a contrived and complicated betting scenario.

"The topic" is whether the challenge faced by the experimental subjects makes any sense. It doesn't; the challenge is to produce a string of six symbols that others can't distinguish from randomness. There is no such string. Your contrived betting scenario doesn't illuminate the issue; it's an attempt to distract attention, and IMO it's not in good faith.

Re:We think this cool study we found is flawed. Help us repr... by baobabKoodaa on Monday May 02, 2022 @01:36PM (#31238217)
> "The topic" is whether the challenge faced by the experimental subjects makes any sense. It doesn't; the challenge is to produce a string of six symbols that others can't distinguish from randomness. There is no such string.

I strongly disagree with that statement. On a surface-level inspection, some strings appear to have more entropy than others ("can be distinguished from randomly generated strings"). This absolutely is a real thing, and it's measurably real. If you genuinely believe what you say, then we can easily wager on it and find out who's right.

> Your contrived betting scenario doesn't illuminate the issue; it's an attempt to distract attention, and IMO it's not in good faith.

You asked me to produce a specific betting scenario, and I did my best to entertain you with that. I crafted the scenario in good faith insofar as I tried my best to answer to your request. I suppose you can still argue that it's not in good faith because I never had any expectation that you would take the wager. But like I said before, that's because there is no way to formulate our disagreement as a betting scenario that you would accept, because you don't genuinely believe the claim you are making here, so you will simply weasel out of any wager.

Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Wednesday May 04, 2022 @02:15PM (#31263950)
I withdraw my accusation of bad faith, and I apologise for that remark.

I call on you to withdraw your claim that my remarks were made in bad faith.

I still don't know why you felt the need to contrive a complicated betting scenario, when we were discussing a "simpler" scenario that already involved an icosohedral die. If we're using betting scenarios to model good faith, then aren't simple scenarios more useful than complex ones? Ergo, coin-toss is the most appropriate.

But trying to talk about this stuff in terms of physical things like coins or dice inevitably turns into discussion about unfair coins and crooked dice, or whether the caster can influence the outcome; so argument by analogy quickly leads to dead ends, in this area.

Re:We think this cool study we found is flawed. Help us repr... by baobabKoodaa on Saturday May 07, 2022 @04:44PM (#31298401)
> I call on you to withdraw your claim that my remarks were made in bad faith.

I don't want to offend you, but I still do not think you believe the claim you are making. If you actually do believe it, we should be able to formulate our disagreement in the form of a wager and use the scientific method to determine which one of us is correct.

> I still don't know why you felt the need to contrive a complicated betting scenario, when we were discussing a "simpler" scenario that already involved an icosohedral die. If we're using betting scenarios to model good faith, then aren't simple scenarios more useful than complex ones? Ergo, coin-toss is the most appropriate.

The die scenario you formulated is not suitable, because it is unrelated to our disagreement. We're looking for a wager that illustrates the disagreement, e.g. you would be taking one side of the wager and I would be taking the other side of the wager. Your die scenario is not like this, because both of us would be taking the same side of the wager in that scenario; it has no connection to our disagreement at all.

I tried my best to formulate a simple scenario that would illustrate our difference and allow us to wager on which one of us is right. Sure we could use coin-toss instead of dice. Feel free to formulate a scenario.

> But trying to talk about this stuff in terms of physical things like coins or dice inevitably turns into discussion about unfair coins and crooked dice, or whether the caster can influence the outcome; so argument by analogy quickly leads to dead ends, in this area.

The disagreement concerns whether a person can produce a sequence of numbers in a way such that another person will/will not not be able to determine whether that sequence of numbers was manufactured or generated by a random process. A generator like coin toss or dice roll is very appropriate here.

Re:We think this cool study we found is flawed. Help us repr... by butwhywhyoh on Sunday May 01, 2022 @09:34PM (#31230489)
This is the telltale sign of someone who is wrong but refuses to admit it. They begin bringing up completely tangential points and ideas to distract from the original argument that they now realize they lost.
Re:We think this cool study we found is flawed. Help us repr... by photochemsyn on Sunday May 01, 2022 @09:10AM (#31224745)
The obvious thing to do is then conduct a physical test on the die, for example trying to spin it on an axis with the 20 face near the top of the axis. An obviously loaded die will not be mass-symmetrical and will not spin well.

In general this is called an independent test for systematic bias and it's something often left out of statistical arguments.

Re:We think this cool study we found is flawed. Help us repr... by squeaky-clean on Sunday May 01, 2022 @04:49PM (#31228550)
> Oh, the die has come up 20, 20, 20, 20, 20, 20, 20 the last seven times. Do you play?

If you let me float the die in a cup of water and spin it to determine its not weighted so the 20 comes up, or have some magical means of assuring me the die is not weighted 100% yes I would play.

It's entirely possible that a fair die rolls 20 7x in a row, but it's more probable that you're cheating.

Re:We think this cool study we found is flawed. Help us repr... by Ygg2 on Sunday May 01, 2022 @08:45AM (#31224584)
It can still be a fair die.

The context implies it's not, but it's only unlikely, not impossible.

See https://youtu.be/8Ko3TdPy0TU

It introduces a 10 billion human second century i.e. 3.1 x 10^19. If your chance times it is greater than 1 then it's definitely plausible to be done by someone, somewhere.

Re:We think this cool study we found is flawed. Help us repr... by whatever1 on Sunday May 01, 2022 @08:47AM (#31224595)
B-but statistics taught me that the events are independent! Take my 10!
Re:We think this cool study we found is flawed. Help us repr... by oneoff786 on Sunday May 01, 2022 @08:49AM (#31224611)
The prompt told you it was independent. Not statistics.
Re:We think this cool study we found is flawed. Help us repr... by johnday on Sunday May 01, 2022 @09:23AM (#31224830)
Neither the prompt nor statistics told anyone it was independent. The prompt just says a 20-sided die, not a fair one.
Re:We think this cool study we found is flawed. Help us repr... by xphos on Sunday May 01, 2022 @10:02AM (#31225072)
Yeah except that can happen. Its vanishingly a small probability but it's not impossible. I would feel that the die is crooked but feelings are not proof
Re:We think this cool study we found is flawed. Help us repr... by denton-scratch on Sunday May 01, 2022 @12:33PM (#31226365)
Hey, out of curiosity, why did you choose a 20-sided die? I assume it was just to match the "ten bucks" bit. I'm not snarking, I just began thinking about 20-sided dice.

I do not believe there is a solid with 20 faces, and all faces congruent (I haven't checked). So we end up with a solid that is roughly ball-shaped, with faces of different sizes and shapes.

[Edit] I checked; I suspected I'd made a fool of myself. An icosahedron has 20 congruent faces, of course.

A ball-shaped die is much more likely to topple, and so more likely to be influenced by small differences in weight distribution, selective corner-shaving, whatever.

I can't think of a way of judging the fairness of a 20-sided die other than casting it many times, and analysing the results. I'd be much more confident in my ability to judge by inspection the fairness of a 6-sided die.

Re:We think this cool study we found is flawed. Help us repr... by mmoll on Sunday May 01, 2022 @11:03AM (#31225584)
You’re comparing apples to oranges. The correct analogy is: you pick any other sequence of numbers between 1 and 20 and then tell me you’re more likely to win because your sequence is more random.