News for hackers. Stuff that matters.
Re:Nearly Half of Game Developers Want to Unionize by prepend on Thursday January 24, 2019 @03:09PM (#18992433)
Not to be pedantic, but this headline is not accurate. There’s nothing that makes me confident that respondents to the game dev conference survey are representative enough to say “nearly half of game developers.”

This is a really important point as trying to represent a bunch of people’s opinion based on a single, limited survey is not productive.

Re:Nearly Half of Game Developers Want to Unionize by criddell on Thursday January 24, 2019 @03:24PM (#18992553)
I would think that conference attendees would be fairly representative of commercial game developers.

I don't know enough about statistics to say how big the error bars would be here, but I'm constantly astonished by how well statistical methods can work with even seemingly small samples.

Re:Nearly Half of Game Developers Want to Unionize by gizmo686 on Thursday January 24, 2019 @03:36PM (#18992656)
The issue isn't with sample size. It is with sample method.

The population of gamedevs who go to a conference is probably not a random selection of gamedevs in general.

Re:Nearly Half of Game Developers Want to Unionize by jcoffland on Thursday January 24, 2019 @04:01PM (#18992918)
I would expect smaller game companies to be less well represented.
Re:Nearly Half of Game Developers Want to Unionize by walshemj on Thursday January 24, 2019 @03:55PM (#18992841)
Its a sample size of 4000 and electoral polls are smaller than that 1k or 3k
Re:Nearly Half of Game Developers Want to Unionize by frobozz on Thursday January 24, 2019 @04:03PM (#18992933)
sample size is irrelevant if the selection criteria are poor.
Re:Nearly Half of Game Developers Want to Unionize by gamblor956 on Thursday January 24, 2019 @05:18PM (#18993613)
If the sample size is large enough the selection criteria doesn't matter.
Re:Nearly Half of Game Developers Want to Unionize by alasdair_ on Thursday January 24, 2019 @07:44PM (#18994499)
Take a sample of 5000 random people (an enormous sample size) attending the Republican National Convention and ask them which party they will vote for.
Re:Nearly Half of Game Developers Want to Unionize by jonas21 on Thursday January 24, 2019 @06:04PM (#18993958)
I guess that's technically true, but only if your sample size is 100%. :-)
Re:Nearly Half of Game Developers Want to Unionize by kolinko on Thursday January 24, 2019 @07:12PM (#18994359)
There were examples of very large polls that failed spectacularly because of the badly chosen samples

https://www.math.upenn.edu/~deturck/m170/wk4/lecture/case1.h...

Re:Nearly Half of Game Developers Want to Unionize by naniwaduni on Thursday January 24, 2019 @03:57PM (#18992874)
The issue isn't with sample size.

The sample is almost certainly biased, we just don't necessarily know how much and in what direction.

Re:Nearly Half of Game Developers Want to Unionize by gdix on Thursday January 24, 2019 @03:57PM (#18992873)
> The issue isn't with sample size.
Re:Nearly Half of Game Developers Want to Unionize by MCrekt on Thursday January 24, 2019 @03:35PM (#18992654)
But considering how many developers don’t live where the conference takes place and/or can’t get there I have to agree with the top here and say this survey is severely limited.
Re:Nearly Half of Game Developers Want to Unionize by walshemj on Thursday January 24, 2019 @04:04PM (#18992948)
it would indicate the better paid ones who can afford to g to industry conferences
Re:Nearly Half of Game Developers Want to Unionize by skybrian on Thursday January 24, 2019 @03:39PM (#18992685)
Well, you can do a lot with a small sample provided that it's a random sample.

It seems like you'd have to know how conference attendees differ from the population of game developers you're interested in.

Re:Nearly Half of Game Developers Want to Unionize by tridentboy on Thursday January 24, 2019 @03:33PM (#18992626)
Statistically speaking 4000 is a good enough number. I mean, election polls in the US usually use less than that for a population of 300 million and they're usually close to the real number.
Re:Nearly Half of Game Developers Want to Unionize by maccio92 on Thursday January 24, 2019 @03:35PM (#18992651)
Except in 2016. And that 4000 is a biased population of only game devs that attended a certain conference. Maybe if it was a totally random sample of 4000 of all game devs it would be statistically significant.
Re:Nearly Half of Game Developers Want to Unionize by learc83 on Thursday January 24, 2019 @03:41PM (#18992712)
>Except in 2016

In 2016 the national polls were very close to the final result--within a couple points. Remember that Clinton won the popular vote.

State polls were less accurate, but the general consensus is they were wrong due to undecided voters breaking more for Trump than is normal in the final few days--after the final state polls were conducted.

That being said, your point stands. Sample method is generally more important than sample size, and 4,000 game devs who self selected to attend a conference is very unlikely to be a representative sample.

Re:Nearly Half of Game Developers Want to Unionize by frobozz on Thursday January 24, 2019 @04:04PM (#18992952)
When they do these election polls, do they stand in the street randomly choosing people coming out of the conference centre where one of the major parties is having their AGM?
Re:Nearly Half of Game Developers Want to Unionize by phkahler on Thursday January 24, 2019 @03:39PM (#18992689)
>> Statistically speaking 4000 is a good enough number.

It seems to me the GP comment meant that because it was a survey among people who attended GDC it's not representative. If that is why they questioned it, I'd say it's an even more relevant survey, as those are the people who care more about the industry and have more influence. No mater how you slice it, I'd say it's an indicator not to be ignored.

Re:Nearly Half of Game Developers Want to Unionize by prepend on Friday January 25, 2019 @06:09AM (#18997071)
It’s an indicator, but just unlikely to be an indicator for the population of game developers.
Re:Nearly Half of Game Developers Want to Unionize by kolinko on Thursday January 24, 2019 @07:14PM (#18994371)
They are taking a very good care to select the right 4000 people.