News for hackers. Stuff that matters.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by ekianjo on Saturday March 26, 2016 @11:42AM (#11366030)
The recommendations at the end of the pdf seem to be written by captain Obvious. They are so generic they can apply to about ANY project even non gamedev related.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by Bahamut on Saturday March 26, 2016 @01:22PM (#11366481)
One of my friends who just left being full time in the game industry pointed out to me that the game industry is 10 years behind in software development best practices. Churn and burn (like many startups) is a daily reality.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by jibberia on Saturday March 26, 2016 @04:10PM (#11367241)
I got into professional game development in the last few years and found that the state of good, modern software engineering practices in the game world is years behind, say, web engineering.

Games are still all closed source. Game engineers prefer to sell their components for a pittance (for example, on the Unity Asset Store) instead of collaborating on GitHub. They really, really hate writing tests. There's a deep reliance on manual testing. They still have a "ship" culture ("who cares about the code, as long as we ship by the deadline?"), disregarding the fact that games run live for years now. Multiple managers actively fought me on doing code reviews (I was new-ish, I wanted my code to be reviewed). I saw and worked on games that had no codified version control branching strategy. No coding standards. Multiple issue tracking systems. A pathetic grip on sharing code among projects. Four implementations of a state machine in one game. It goes on.

I'd like to think it was just my employer's problem, but from talking to people who have been in games for a long time, it's endemic to the industry.

I'm now out of the industry :)

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by JabavuAdams on Saturday March 26, 2016 @06:27PM (#11367738)
I still remember suggesting code reviews to my dev manager in 2003-ish. He didn't know what they were, and scheduled a meeting where he could review my performance, instead. Awkward.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by jblow on Saturday March 26, 2016 @02:22PM (#11366754)
If your friend was not very senior (10+ years experience), I would not believe what he says, since he probably did not have enough experience to judge the situation.

I think the idea that the game industry is "behind" other fields is kind of comical, given that games are some of the most complex software in the world, and big game teams have only a few hundred people on them, and meanwhile something relatively trivial like Twitter has 4000 people. It's true that game teams don't do a lot of Agile or TDD or whatever the next buzzword is, but that is because those things are mostly superstition and obviously don't work when you start attacking hard problems.

So if you are someone a few years out of school who learned TDD it is easy to say "games are behind, they don't do all the new stuff!!" while being unaware that almost all the new stuff is bogus cargo-cultism anyway.

I do agree that the game industry engages in unhealthy levels of crunch that are to its long-term detriment, but this is mostly an orthogonal issue to software engineering practices.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by hythloday on Saturday March 26, 2016 @02:42PM (#11366833)
I was in the games industry from 1999 to 2012 (and then left to go to Twitter!) and I think his friend is absolutely right, the games industry shoots itself in the foot repeatedly by believing that it's a special snowflake full of "hard problems" that no-one else tackles and continually (and badly) tries to reinvent the wheel. The universal culture of deathmarches and the denigration of mainstream software engineering and project management techniques are not in any way coincidental.

(I loved the Witness, btw.)

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by pandaman on Saturday March 26, 2016 @08:52PM (#11368286)
If only game studios could raise money on negative profit margins instead of being forced to deliver milestones to be able to run regular operations... Every day I'd be writing unit tests and doing standups in between code reviews and updating my GitHub profile.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by hythloday on Saturday March 26, 2016 @11:08PM (#11368677)
If you're comparing them to VC-funded startups, games studios run on negative profit margins until the game is released!
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by pandaman on Saturday March 26, 2016 @11:27PM (#11368730)
Some might, but it's not a common business model. Most game studios work for publishers and they sell the game continuously in form of milestones. Even a studio owned by publisher has to continuously deliver or it will be shut down. Twitter, which I am comparing to, just gets money on the promise of the future profits. Correct me if I am wrong, but I don't believe it has any software deliverables it has to meet every quarter in order to make payroll.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by hythloday on Sunday March 27, 2016 @12:36AM (#11368895)
Twitter, now, sells advertising, which is 90% of its revenue. While it was VC-funded, which is really what you should be comparing it to as it's the prevalent stage of an startup, it raised money from VC funds by hitting non-contractual milestones in terms of MAU/DAU increases. I don't think that's particularly different to the milestone model that's prevalent in games - a third party pours money incrementally into the development of a product contingent on the mutually agreeable evolution of the product.

Unless you're in the habit of delivering RC-quality milestones (which is afaik unheard of in AAA development), the marginal value of a milestone is negative right up until the last one.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by pandaman on Sunday March 27, 2016 @01:18AM (#11369002)
I am sorry, it seems that my point is completely lost behind snark. Let me put it straight then.

The argument in this thread is that games industry is somehow behind times and not using the best practices used at places such as Twitter. The question is - how do you know your practices are the best and not the other way around?

Game studios go out of business if they don't deliver quality software on time and on budget. I know it first hand since I have been through several studio closures. The practices game studios use are tested through natural selection - if they fail at delivering software they are out of business. To make things more interesting there is also competition: a good game decimates sales of the worse games released around the same time. And if the sales go below the projected ROI - it's the game over. So it's not enough to be good enough to survive, you need to be better than the competition.

Trendy web companies don't sell software. They sell services and the quality of software they use is secondary. E.g. if I wrote a Facebook's clone but 100 times faster, using 10 times less memory and with 1/1000th of Facebook's staff it would not threaten Facebook. People would not close their accounts and move to my network just because I have better software. A web company is fine as long as their website runs semi-reliably.

So how come the battle-tested practices of the games industry are so bad compared to the practices of the industry, which mostly sells advertisement? What are the criteria you use to compare?

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by emelef on Sunday March 27, 2016 @05:14PM (#11371592)
Games are more like web products than you think, I'd say. If you come up with a game-stack: 3d engine, netcode, the works, that vastly outperforms a game like League of Legends, that does nothing to threaten them either.

I'm not siding with this notion that Twitter (or webdev in general) is ahead, mind you, but it's fair to say that neither websites nor games are about selling software. They're more about entertainment.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by pandaman on Sunday March 27, 2016 @05:59PM (#11371745)
You are right, f2p games are a lot like web - they sell service, not software. Interestingly, these companies look a lot like web firms - thousands of people working on the product, which barely changes and, I've heard, using the same programming practices. This is not what people mean when talk about games industry.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by hnbro on Saturday March 26, 2016 @07:21PM (#11367968)
> something relatively trivial like Twitter has 4000 people

there is more to twitter than the web app you type dozen words into.

i don't much about them (including whether 4000 is accurate), but presumably there's a lot to work on regarding international near-realtime messaging infrastructure, high availability, machine learning, sentiment analysis, smart advertising systems, yadda yadda. 4k does seem like a lot, but i doubt their suits are interested in needlessly hiring people to sit around picking their nose.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by vvanders on Saturday March 26, 2016 @03:07PM (#11366955)
I would argue that crunch is at the root of good software development practices.

I've spent time in the industry and its behind in practices, wages and quality of life. There may be some smart, motivated people but the industry as a whole has not grown well.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by louhike on Saturday March 26, 2016 @03:15PM (#11366997)
TDD might not apply well to games because they are used by big corporations for 15 or 20 years. It makes more sense when you're working with old legacy code and you want to add features to it. Unit tests are definitely not a all-around solution but they have their use cases.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by enjo on Saturday March 26, 2016 @05:53PM (#11367626)
It makes more sense when you're working with old legacy code and you want to add features to it.

No!!

Testing is not merely about future proofing (although it's a really nice benefit), it's about proving that your code actually works now. By writing tests and verifying that they pass you can be sure that the code actually does what you think it does. Furthermore you can ensure that when other parts of the code changes your code still does what you think it does, which might be an issue tomorrow, next week, or in ten years.

\* note: Testing does not prove that your code is correct, only that it satisfies the conditions of the test. As with all engineering testing is only effective as the person implementing it.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by JabavuAdams on Saturday March 26, 2016 @06:29PM (#11367752)
Unit testing makes a lot of sense for game engine code, but less so for game-logic code, which tends to be highly volatile and specified only qualitatively.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by true_religion on Saturday March 26, 2016 @08:56PM (#11368304)
A lot of bugs in games involve asking if state is X,Y,Z ... does A actually execute.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by quantumpotato_ on Saturday March 26, 2016 @06:37PM (#11367786)
Maybe you would say that most webapps, no matter the complexity of business logic are "not hard", but I've seen TDD work quite well and practiced by senior (10+ years) programmers to great success.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by yread on Saturday March 26, 2016 @12:09PM (#11366143)
Well they weren't that obvious to 155 projects it seems...
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by quakenul on Saturday March 26, 2016 @01:20PM (#11366469)
I would assume it was (to most of them) but knowing and doing are two very different things (i.e. everyone knows smoking is bad for you and yet people still do it / start doing it).

So to me the far more interesting and helpful question to answer is: Are there most efficient ways to keep people from making the same mistake over and over, other than repeating what everyone already knows, over and over?

Identify the forces that drive people away from best practices most often and give us ideas and tools to tackle them.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by tslug on Saturday March 26, 2016 @01:49PM (#11366612)
The best approach is to apprentice with someone who knows not to make them. If you can't do that, check in with someone regularly who:

  1. Won't sugar coat feedback,
  2. Has shipped games,
  3. Has a healthy sense of humility, and
  3. Is genuinely concerned about your success.
I really like sitting on advisory boards in this role, but my secret to being good at it is that I regularly ask for feedback from others who are smarter than me at the things I don't get (which is most things).

In the long run, it's like most things. It takes practice.

To the criticism that the game industry is behind the rest of the software industry in software engineering practices, I do believe the rest of the software industry can eat something phallic. :)

I'd like to see them pull off what we have to with about 10X the competition, juggling massive game assets, a fraction of the budget, finance, and exit options, needing to meet a tough frame rate budget (even more exacting now with VR), all issues GPU-ish (when was the last time you wrote a shader, Mr. Website Developer?), and having people with a huge range of technical skills requiring direct access to the source/asset repo.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by hythloday on Saturday March 26, 2016 @04:34PM (#11367332)
Something about your last paragraph rubbed me the wrong way. Sorry.

> about 10X the competition

Steam added 1500 games in the first 7 months of 2015. Crunchbase had over 8000 investments in 2015. So I don't think that's true, even accounting for a Christmas peak.

> juggling massive game assets

Lots of data goes into games, lots of data comes out of websites. The difference to my eyes is that the industry has multiple, principled, well-understood frameworks to deal with the data problem and the games industry has...what? Maybe the state of the art has moved on in the last 5 years but when I left it was all "well it's just a DAG, how hard can it be to write a tool to recursively build it".

> a fraction of the budget, finance, and exit options

Being willing to work for less and with fewer resources is not a sign of good engineering practice. I don't know if I'd say it's the opposite but it's at best irrelevant.

> a tough frame rate budget

Not very different to needing to meet tough latency/error rate SLAs, except instead of failing TRC (or getting your exec producer to stare down MSFT/Sony), you'll just go broke. Oh, and you don't know what the SLA is, ever, so it's a continuous process of tradeoff.

> all issues GPU-ish (when was the last time you wrote a shader, Mr. Website Developer?)

Ignoring that some "website developers" (many of whom are not "Mr" - something else that the games industry does not do well at) do write shaders in the form of GPGPU optimization of ML tasks, obviously tasks differ. Let's not pretend that banging out something in Cg is PhD-level shit. It's not harder than writing a Spark job, for sure.

> having people with a huge range of technical skills requiring direct access to the source/asset repo.

You have Mr. Blow upthread sneering at Twitter for employing 4000 people to build something "trivial" but you think that each of those people have identical programming chops in every bit of the code they touch? If there's a single thing that argues against your idea it's this - the rest of the industry has become pretty good at modularizing areas of the business and auditing changes to it with code review, build/asset/deployment tagging etc. The last games company I worked at, someone stayed at the office until 5am before going on holiday for a week and sent an email that effectively said "I've rewritten quite a bit of the engine, you'll probably need to fix the build because I didn't test anything, see you in a fortnight". People gasp when gmail/twitter/facebook is down for half an hour but I've worked in places where there _wasn't even a canonical build_ that could be broken.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by erikbc on Sunday March 27, 2016 @09:20AM (#11369875)
"Let's not pretend that banging out something in Cg is PhD-level shit."

Almost everything you implement in CG is "PhD-level shit". Implementing techniques from SIGGRAPH papers in your game engine are usually non-trivial. Game engines/games are some of the most complex systems in software engineering, the complexity can't be compared to web apps at all.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by hythloday on Sunday March 27, 2016 @06:07PM (#11371763)
I think by CG you mean computer graphics? Cg was nVidia's shader language that compiled to HLSL or GLSL. Writing shaders is sometimes serious business but more often than not it's just as drudgey as writing CRUD pages.
Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by jacques_chester on Saturday March 26, 2016 @01:31PM (#11366531)
Empirical research often turns up "no duh" results.

It also, often, doesn't.

In both cases, there is value in publishing.

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by Kristine1975 on Saturday March 26, 2016 @11:57AM (#11366091)
>The recommendations at the end of the pdf seem to be written by captain Obvious.

Doesn't that simply mean that this research confirms other people's experience/gut feeling?

Re:“What Went Right and What Went Wrong”: Analysis of 155 Po... by ekianjo on Sunday March 27, 2016 @01:08PM (#11370611)
It simply means the research is not insightful.