News for hackers. Stuff that matters.
Re:Grandmaster level in StarCraft II using multi-agent reinf... by bsaul on Thursday October 31, 2019 @10:20AM (#21409083)
Has anyone read the actual paper ? This summary really makes it look like "mission accomplished", but this was much much more interesting than that. We saw AI do "obviously stupid things", and we also saw them improve a lot in the middle of the trial, as many youtubers showed.

AI was also much more interesting when playing the protoss race, and really felt like it was responding to the opponents actions, and the other races not so much.

But most surprising is that it didn't make any "breathtaking" moves or actions, as opposed to AlphaGO. Actually not a single game made pro player realize something new about the game. Which is really embarassing, because it suggests that the AI just was able to correctly reproduce existing strategies and build orders, that it probably "learned" from existing pro games in the training sample.

I was really hoping for a more interesting report, honestly explaining the shortcomings of the technics used and giving hints for the obvious blunders. As well as a roadmap for a second round, this time aiming at beating the very top players.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by papreclip on Thursday October 31, 2019 @01:06PM (#21411036)
IMO it's a testament to how games like SC are collectively and thoroughly "solved" by the community, and how the games aren't that complex after all. I never followed SC or SC2, but my observation of the pro scene and competitive ladder for Warcraft 3 was that cookie cutter strats dominated. Pro players were typically those who executed best, not those who innovated best.

Personally I felt disappointed by the fact that real-time strategy played a pretty minor role in RTS games. If you left the well-beaten path of cookie cutting and tried something new you invariably gave up a pretty obvious advantage to do so.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by jammygit on Thursday October 31, 2019 @08:29PM (#21415190)
Former masters Zerg here. You are partially correct, but actual high level play involves a great deal of small variations to these cookie cutter strays, and these small variations lead to a constantly evolving metagame. A good example was the kespa league during hots where innovation and strategy played a big role.

It’s just that a lot of that strategy is irrelevant unless you have amazing mechanics - and the difficulty of those mechanics means that you can’t as easily think, plan, or adapt in-game (because your brain is busy)

A big part of the game is thinking about “how do I win against somebody who does that...” between games

Re:Grandmaster level in StarCraft II using multi-agent reinf... by JamesBarney on Thursday October 31, 2019 @03:11PM (#21412470)
There is a lot of strategy in RTS's but alpha star doesn't need to exploit any of it because it can win on mechanics. It has perfect macro, and perfect micro, which allows it to beat players without having to learn strategies or tactics.

It's kind of like competing against a gorilla in boxing chess. Just because a gorilla is dominant doesn't mean boxing chess doesn't require chess skills, only that a gorilla doesn't need them.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by DuskStar on Thursday October 31, 2019 @04:40PM (#21413491)
Are you sure it has perfect micro? Can you even execute perfect micro on 30 actions per 5 seconds?
Re:Grandmaster level in StarCraft II using multi-agent reinf... by confidantlake on Friday November 01, 2019 @02:53AM (#21416712)
"Perfect" no, much better than any human yes. 30 actions per 5 seconds is 360 actions per minute. The very top players might have similar stats, but the similarities would end there. A lot of human actions are mindless spam clicking and those 300+ actions would contain several misclicks. The ai would never misclick. They can also do things like pull back every weakened unit before it died much more accurately than a human. A human knows to do these things but it has much less mechanical skill than the ai.
Re:Grandmaster level in StarCraft II using multi-agent reinf... by friendlybus on Thursday October 31, 2019 @05:52PM (#21414097)
Cookie cutter strats or the metagame changes over time. Knowing what strategies you are likely to face influences what strategy you are likely to try. The meta is different across regions. The europeans play differently to the americans who play differently to the koreans. Some people dedicate themselves to different playstyles and your 'cookie cutter' strat will have to grow with everyone else's. They patch the game often to update the balance.

Designing a game that is a fun and balanced experience whilst also encouraging true innovation is a difficult problem. Every game ever has this problem, putting thousands of minds on a problem and letting them confer about their results usually solves all the low-hanging fruit in about a week. Creating a game where you only play to share a new idea makes each match feel like a dice roll.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by ajuc on Thursday October 31, 2019 @01:30PM (#21411361)
> my observation of the pro scene and competitive ladder for Warcraft 3 was that cookie cutter strats dominated. Pro players were typically those who executed best, not those who innovated best.

Warcraft 3 and broodwar were much more micro-oriented than sc2 (because ai was much worse for example if you let dragoons to walk to their target on their own they spend half the time fighting broken pathfinding while the enemy shoots at them :) This almost never happens in sc2, and microing units below master league is usually detrimental to the game).

I think the micro vs macro is not the full image, and sc2 lets player express themselves on what i would call mediumgame (something that is between buildorders and microing - like deciding when to expand, what tech-switch to make, how to position your army in between fights, etc).

There's lots of decisionmaking that isn't APM-limited but thinking-time limited in SC2, and it's not as codified as buildorders. But you can certainly simplify the games to "archon immortal vs bio terran", and then it's very repetative.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by nitwit005 on Thursday October 31, 2019 @04:45PM (#21413548)
It's a bit more interesting when people play several matches against each other. They are forced to switch tactics.

Raw, spur of the moment, innovation probably isn't a good idea generally, as you'd be doing something with no practice. People do have a fairly big bag of tricks from older tactics that are less common these days.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by foolfoolz on Thursday October 31, 2019 @01:13PM (#21411146)
because the real skill is in the micro
Re:Grandmaster level in StarCraft II using multi-agent reinf... by Jyaif on Thursday October 31, 2019 @11:24AM (#21409782)
> Actually not a single game made pro player realize something new about the game.

People are now over saturating their mineral line (making more probes than before), so I don't think that's true.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by jcampbell1 on Thursday October 31, 2019 @12:43PM (#21410729)
There were other cases of this such as 3 rather than 2 early air units. The AI seemed to anticipate losses in a way that is almost more rational than humans.
Re:Grandmaster level in StarCraft II using multi-agent reinf... by chillacy on Thursday October 31, 2019 @11:33PM (#21416075)
I remember it also built like 8 observers in one match, supposedly because the AI was so good at sniping them (and it trained on itself).
Re:Grandmaster level in StarCraft II using multi-agent reinf... by Nimitz14 on Thursday October 31, 2019 @07:01PM (#21414664)
This is wrong. See posts here from ptitdrogo: https://www.reddit.com/r/starcraft/comments/d4n3tw/alphastar...

> People oversaturated in wol and hots because you didn't expand a lot in these games and bases have a lot less minerals in LOTV, not because of some kind of lost knowledge like some comments seem to think here.

[...]

> Meanwhile alphastar was going 2 gate robo staying on one base making a fuck ton of probes to take a super late natural, it was bad, and anybody calling it the future really bothered me.

Alphastar has not introduced anything new. Its play is strategically poor.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by jammygit on Thursday October 31, 2019 @08:33PM (#21415209)
Can confirm. I did experiments and math about this years ago- overtraining workers is only good if you know you are about to get severely harassed and plan to lose a bunch
Re:Grandmaster level in StarCraft II using multi-agent reinf... by vkou on Thursday October 31, 2019 @04:13PM (#21413213)
Why?

Is it because they expect to lose workers to harassment? Or is it so that they can saturate new expansions quicker?

Re:Grandmaster level in StarCraft II using multi-agent reinf... by perseusmandate on Thursday October 31, 2019 @06:16PM (#21414341)
In terms of total mineral output oversaturating would seem to be disadvantageous since being able to get more workers on the new mineral line is offset by the cost of not expanding sooner and then being able to build from both bases.

I'm interested to understand why Alpha did this since worker production seems like one of the most solved and optimized parts of the games and not where you'd expect innovation

Re:Grandmaster level in StarCraft II using multi-agent reinf... by chillacy on Thursday October 31, 2019 @11:34PM (#21416077)
Most people speculate it's to account for losses from harassment where it somehow finds easier to overprobe than bother with more defense.
Re:Grandmaster level in StarCraft II using multi-agent reinf... by ionforce on Thursday October 31, 2019 @12:13PM (#21410332)
> But most surprising is that it didn't make any "breathtaking" moves or actions, as opposed to AlphaGO.

I don't play any competitive StarCraft so my view might be moot but I was surprised at the number of siege tanks it uses. It made me wonder if there's some critical advantage to having so many tanks stacked up in a line so that the splash is spread out.

Also I find it weird that it did not build any marauders at all, in any of the games I've seen.

And just in general, no sexy units. No battlecruisers, no infestors, no swarm hosts...

Re:Grandmaster level in StarCraft II using multi-agent reinf... by Mirioron on Thursday October 31, 2019 @12:32PM (#21410602)
>Also I find it weird that it did not build any marauders at all, in any of the games I've seen.

This is off-topic, but I was thinking about this the other day - couldn't AI be used to balance a competitive game in this sense? Imagine that the AI becomes so good that human players very rarely win against the AI in a best of 7 series. Then we find out that AI doesn't ever build a specific unit. That would be a pretty strong indicator that said unit isn't good enough compared to the rest.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by ionforce on Thursday October 31, 2019 @12:45PM (#21410759)
You wouldn't be the first person to say this. But it only proves that the unit isn't useful __ as piloted by AlphaStar __.

Based on the initial AlphaStar against TLO/Mana, you would think that Stalkers are insanely OP and the only thing worth building.

I (and others) have wondered that if you continue to lower AlphaStar's APM, you would see a diversity of units. The money would be in where AlphaStar decides to spend its really tight APM budget. Is it worth casting that Psionic Storm?

I personally feel like it has an insane micro advantage by being able to select arbitrary units on the battlefield, as opposed to dragged squares or control groups. But I'm not a pro gamer, so I don't know what that feels like.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by mattnewton on Thursday October 31, 2019 @12:46PM (#21410777)
You can also do this directly with metrics on human games. It’s something that I know wizards of the coast does with Magic the Gathering decklists, just counts the copies of cards and keeps track of the “conversion rate” of them (how likely is this deck to pass some threshold, like have a positive win percentage, given that it has this card). They are doing it primarily to spot ban targets (the paper aspect of cards means you can buff without printing a new set of cards), but it is the same idea.
Re:Grandmaster level in StarCraft II using multi-agent reinf... by NoodleIncident on Thursday October 31, 2019 @01:35PM (#21411438)
This sounds like it was posted before the link was changed, but at least one pro was impressed by its novel style:

> AlphaStar is an intriguing and unorthodox player – one with the reflexes and speed of the best pros but strategies and a style that are entirely its own. The way AlphaStar was trained, with agents competing against each other in a league, has resulted in gameplay that’s unimaginably unusual; it really makes you question how much of StarCraft’s diverse possibilities pro players have really explored.

- Diego "Kelazhur" Schwimer, professional StarCraft II player

Re:Grandmaster level in StarCraft II using multi-agent reinf... by bsaul on Thursday October 31, 2019 @03:50PM (#21412932)
yes indeed, it seems the most recent batch of games brings interesting new things
Re:Grandmaster level in StarCraft II using multi-agent reinf... by the_af on Thursday October 31, 2019 @10:48AM (#21409411)
> Actually not a single game made pro player realize something new about the game. Which is really embarassing, because it suggests that the AI just was able to correctly reproduce existing strategies and build orders, that it probably "learned" from existing pro games in the training sample.

Why is it embarrassing if the AI behaved like a collection of all the knowledge of existing pro players?

Obviously it'd be more interesting if we also learned something new about the game. Or AI, or both.

Re:Grandmaster level in StarCraft II using multi-agent reinf... by UserIsUnused on Thursday October 31, 2019 @12:50PM (#21410828)
Interesting.

I watched Dota2 first OpenAI 5v5 show at TI8, and they did had different actions, like which spells used to initiated, how some spells are used, etc.

But tht AI was very limited in Hero pool.