News for hackers. Stuff that matters.
Re:TDD from the Factorio Team by beckingz on Friday June 18, 2021 @09:28AM (#27550043)
Good luck doing this for a huge modern AAA game.
Re:TDD from the Factorio Team by mywittyname on Friday June 18, 2021 @10:43AM (#27550895)
I've always assumed they did this for games like LoL.

Bots already exist, so the foundation for automated play testing is in place. Take the basic AI and add some functionality to track the effectiveness of various skills or loadout across plays. Using A/B/n testing to choose the most effective character strategy would probably highlight overpowered loadouts within a few thousand game-test-hours.

They could probably take analytics from real players and do what's outlined above and get a reasonable idea of the impact a change will have.

Re:TDD from the Factorio Team by anchpop on Friday June 18, 2021 @11:01AM (#27551085)
The issue with that is that LOL bots are laughably bad, and making them not bad requires a substantial investment. But something like what you describe is possible. OpenAI has a paper where they evaluate chess variants by training AlphaZero on them and seeing which ones generate more balanced games between white vs black, and which ones lead to more dynamic games with fewer stalemates etc.
Re:TDD from the Factorio Team by 8note on Friday June 18, 2021 @12:46PM (#27552280)
Stalemate a are great fun; it's "the players agreed to a draw" and "draw by repetition" that are boring
Re:TDD from the Factorio Team by wbc on Friday June 18, 2021 @11:57AM (#27551702)
I dont think they used bots to test, just rpc endpoints, at least as of 2016 blog:

https://technology.riotgames.com/news/automated-testing-leag...

Re:TDD from the Factorio Team by kempbellt on Friday June 18, 2021 @12:06PM (#27551800)
This is likely why "Game Tester" is an actual job, or at least used to be. 14 year old me didn't believe it was a real thing...

"Early Access" seems to be the more popular route now. People are happy to pay to test a game and feel like they participated in its development. Check out Star Citizen if you want to be amazed and depressed by this truth at the same time.

Sometimes it works well. Sometimes it doesn't. Seems largely dependent on how engaged the devs are with their community.