News for hackers. Stuff that matters.
Re:Using achievement stats to estimate sales on Steam by anonnyj on Wednesday July 04, 2018 @09:08AM (#17457046)
Random thought about the accuracy: If you published a game on Steam, you've probably noticed that many owners haven't cleared even "opened up the game" tier achievements.
Re:Using achievement stats to estimate sales on Steam by bartervg on Wednesday July 04, 2018 @10:47PM (#17460551)
Yes, this is an issue.

One example is FreeFly Burning, which according to the achievement estimation method has 739 players [1]. Yet, the game has sold 25,562 keys through Go Go Bundles, and more through other bundles. Go Go Bundles lists the number of bundles delivered [2] and each bundle includes every game (in contrast to Humble Bundle that has tiers). This is consistent with Steamspy's estimate of 20,000 - 50,000 owners [3]. Those bundle buyers likely never downloaded the game and perhaps haven't even activated the game on Steam.

With exceptions like F2P games or free weekend games: Units Sold >= Owners >= Players

[1] https://barter.vg/i/40567/a/

[2] https://www.gogobundle.com/latest/bundles/bundlemega-7

[3] https://steamspy.com/app/683530

Re:Using achievement stats to estimate sales on Steam by larsiusprime on Wednesday July 04, 2018 @03:08PM (#17458925)
I reviewed the algorithm, and as long as you have SOME users at all registering some amount of achievements, the method is quite accurate. Even if most players register no achievements, they still count towards the overall pool of "achievers" and provide a solid base for doing the calculation.

You can verify this yourself with the supplied source code.

The only cases where it can fail are:

1) When there is no achievement data

2) When there are not enough independent achievement %'s.

2 Can happen for games with very few achievements -- but in practice, if a game has even 3 achievements the chances of this happening become very small.

TL;DR -- for very nearly every game on Steam, this was an extremely accurate method for estimating the number of "achievers" for that game. The tricky bit is correlating "achievers" with a metric you actually care about, like e.g. actual sales.

Re:Using achievement stats to estimate sales on Steam by ant6n on Wednesday July 04, 2018 @05:37PM (#17459569)
Isn't that the point of anonnyj? I.e. you don't know which % of sales are made without even registering a single achievement.
Re:Using achievement stats to estimate sales on Steam by larsiusprime on Wednesday July 04, 2018 @07:30PM (#17459975)
Yes you do. Because even if they don't register an achievement, they still show up as part of the total population of possible "achievers". I've verified this from my own stats as a developer and that of other developers.

As long as any portion of the userbase registers some achievement data, you can (well, could) get scarily accurate stats.

The only "inaccurate" part is that the stat you're measuring -- "achievers" -- doesn't exactly correlate to any stat we directly care about, like sales. In all the measuring I did against known private sales data, it was always higher than the # of people who had downloaded the game, and the # of people who had played it for at least 1 minute. My best guess is family sharing inflates the "achievers" stat.

Re:Using achievement stats to estimate sales on Steam by pixl97 on Wednesday July 04, 2018 @09:53AM (#17457251)
I've bought many games on sale and never installed them. Maybe one day I will, maybe I wont. My take is games that never have sales are more likely to be installed and ran.
Re:Using achievement stats to estimate sales on Steam by GuB-42 on Wednesday July 04, 2018 @10:24AM (#17457416)
Also, bundles.

I have a dozen of game I have never played, and will probably never play. They were part of a bundle that was cheaper than the individual game(s) I wanted.

Re:Using achievement stats to estimate sales on Steam by hhmc on Wednesday July 04, 2018 @01:22PM (#17458376)
Also, some games had their achievements added after release (in some cases years). Achievements don't usually get backfilled to my knowledge, so any players with playtime before achievements will be underrepresented.
Re:Using achievement stats to estimate sales on Steam by larsiusprime on Wednesday July 04, 2018 @07:45PM (#17460019)
This isn't the case, actually. Testing it against known sales data, the "achievers" stat derived by this method was ALWAYS higher than the # of ppl who had downloaded the game, or the # of ppl who had played it for at least 1 minute (these stats are known privately to developers).

We don't know exactly how the total "achievers" pool for a game is calculated, but we know it isn't a simple measure of people who had achieved at least one achievement. It's almost certainly some measure of the total population that is able to register achievements, regardless of whether they have registered any.

It probably includes something like family sharing accounts, so it doesn't exactly correspond to actual sales directly, but it seems to be roughly in the middle between the "players" and "owners" stats SteamSpy used to report. Sometimes it would overshoot both, but it was never less than "players."

Re:Using achievement stats to estimate sales on Steam by AdmiralAsshat on Wednesday July 04, 2018 @03:09PM (#17458937)
Yep. I even wonder if Steam has some kind of counter that would show me "Number of games you own that you've never played." I would probably be horrified.
Re:Using achievement stats to estimate sales on Steam by Deimorz on Wednesday July 04, 2018 @03:15PM (#17458963)
SteamDB's calculator can tell you that: https://steamdb.info/calculator/

It splits out a chart showing you how many games you have in a few different playtime categories ("12 or more hours", "6 to 12 hours", "Never played", etc.)

Re:Using achievement stats to estimate sales on Steam by lainga on Wednesday July 04, 2018 @04:18PM (#17459264)
There was an event a few weeks ago where Steam prompted you to play a game in your library that you had never opened or not opened in a long time.