TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

StarCraft Micromanagement with Reinforcement Learning and Curriculum Transfer

98 pointsby mav3r1ckabout 7 years ago

9 comments

calebhabout 7 years ago
For those who don&#x27;t know Starcraft: microing refers to the small scale&#x2F;precise maneuvering of units during a battle, as well as activating special unit abilities at certain times. In the lower level leagues microing is not as important as having a good overall large-scale &quot;macro&quot; strategy. The microing really starts coming into play at the higher levels where it can give the edge needed to win a battle.<p>I am not very surprised that machine learning has been able to successfully execute micromanagement. In my opinion the macro decisions are more interesting, since they typically require higher level reasoning (and comprehension of what the opponent is doing). We have yet to see an AI system that can successfully execute macro strategy when playing against a human opponent.
评论 #16881005 未加载
评论 #16881033 未加载
WhompingWindowsabout 7 years ago
Creating a micromanagement AI is only the first step. This must be piped into a macro AI, which produces the units with with micromanagement can be done. Then, another critical layer beyond micro or macro is scouting the opponent and predicting what their plan is. Next, you need to adapt your own strategy, which must also be planned at the start of the match since you can&#x27;t scout instantaneously or perfectly. Finally, your own initial strategy choice must be tailored to the map, to the player you&#x27;re playing against, to recent games&#x2F;strategies other pros have exposed as powerful&#x2F;weak. There are an incredible number of layers of complexity to what a truly fierce Starcraft AI would need to do.<p>And yet, something similar may have been said about Go, Chess, Checkers, Poker, Jeopardy, or many other games before this. If enough talented minds and powerful devices focus on Starcraft, how would humans compete? Does anyone here think top pros would win in a best of 7 or a best of 11, for instance? Which top pros, and BW or SC2? To me, I just think it&#x27;d be arrogant to assume SC is different from all the other realms in which humans have been bested by machines.
评论 #16882951 未加载
评论 #16882804 未加载
daemonkabout 7 years ago
I want an AI assisted mode with API hooks where people can code their own sophisticated &quot;macros&quot; that can be activated with a command&#x2F;button. Limit the code to X number of characters. It would be awesome to see a tournament with this.
评论 #16880907 未加载
评论 #16883115 未加载
评论 #16881295 未加载
taylorswift_about 7 years ago
Interesting, outside of the academic merits of the research, I wonder if they could partner with Blizzard (or other similar RTS game studios) and start shipping games with AI that is very difficult to beat? That would usher in a new era of solo and offline game play that could be very fun and challenging! Plus we&#x27;d be training Skynet, err, I mean the neural network in the process!
评论 #16882126 未加载
评论 #16881126 未加载
taurathabout 7 years ago
I&#x27;ve always felt like macro is pretty easy to automate, once you&#x27;ve identified a lot of the potentials in the early game you can get going pretty well. Is AI playing against each other getting to some sort of endgame consistently (against equal opponents), or are they having blowouts because of some small difference in midgame?<p>Also wondering what the interface is - are they creating a virtual mouse&#x2F;keyboard to enter inputs, are they playing in some sort of headless mode? How do they deal with recognizing units?
评论 #16881144 未加载
wesleytoddabout 7 years ago
But can your AI learn to drop mules so it can capture some escaping ultras?<p>Better link: <a href="https:&#x2F;&#x2F;clips.twitch.tv&#x2F;BusyDrabFennelRedCoat" rel="nofollow">https:&#x2F;&#x2F;clips.twitch.tv&#x2F;BusyDrabFennelRedCoat</a>
评论 #16881104 未加载
mLubyabout 7 years ago
Three great short videos showing an old StarCraft bot in action. I recommend watching #3 then #2. The second shows a pro player for comparison.<p><a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;channel&#x2F;UCOBfAiPhRlKOhdJHaAJ2OpQ" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;channel&#x2F;UCOBfAiPhRlKOhdJHaAJ2OpQ</a>
partycoderabout 7 years ago
The thing with StarCraft is that there are many types of units and types of damage, you need to alternate between moving and attacking, different units have different roles in a formation, etc.<p>When I pick targets I prefer to kill units that deal the most damage or have low HP first.
spectaclepieceabout 7 years ago
Anybody know if the military in any country is looking into using similar strategies to manage real wars?