News for hackers. Stuff that matters.
Re:TDD from the Factorio Team by mschuster91 on Friday June 18, 2021 @07:42AM (#27549373)
Testing? In games? There is no such thing on a wide scale, not anymore since the cost of distributing patches essentially became a small budget line for a CDN.

Modern games are notorious for using the first, most loyal customers as beta testers (hello Fallout 76...).

The reason is two-fold... while you absolutely can test some parts of the engine (e.g. collision detection, networking) you can't really "test" stuff that needs a human eye to see if it's working as intended (anything that's rendered) or involves randomness (e.g. fire, fog, water, opponent spawning, loot). That means you have to hire lots of skilled (!) humans, provide them with expensive rigs, and give them time. Which is incredibly expensive.

Re:TDD from the Factorio Team by gmueckl on Friday June 18, 2021 @08:09AM (#27549506)
Just to give you some perspective: my current employer's main product isn't called a game, but it has an engine at its core that is a game engine in all aspect except its name. And we test the sh*t out of it. We have thousands of automated and very sensitive tests on that stuff. Our test suite goes as far as testing for pixel perfect output. And this involves stuff that is "random". It took us some effort to be random in a perfectly reproduceable way, but we got there.

Game QA is more involved than that, of course. Content needs to go through a signoff and QA process that involves humans (we do that, too).

Re:TDD from the Factorio Team by kempbellt on Friday June 18, 2021 @12:10PM (#27551842)
This is definitely true for some games, and Early Access is increasingly popular, but for others, QA and testing is definitely a part of the development process.

I interviewed at a game company a few years ago where one of my daily tasks would be to spend an hour just playing the game and seeing if I spot any bugs. I didn't end up taking the job so I didn't see how involved their actual code testing process was, but it was apparent that they actually cared a bit about quality control.