AlphaStar (software)

For the broadcasting service, see AlphaStar (satellite broadcasting service).

AlphaStar is an artificial intelligence (AI) software developed by DeepMind for playing the video game StarCraft II. It was unveiled to the public by name in January 2019. AlphaStar attained "Grandmaster" status in August 2019, a significant milestone not just for AI in video games, but arguably for the field as a whole.

Background

Games created for humans are considered to have external validity as benchmarks of progress in artificial intelligence. IBM's chess engine Deep Blue (1997) and DeepMind's AlphaGo (2016) were considered major milestones; some argue that StarCraft would also be a major milestone, due to the game's "real-time play, partial observability, no single dominant strategy, complex rules that make it hard to build a fast forward model, and a particularly large and varied action space."[1] Though difficult, StarCraft may still be tractable with current technology because "its rules are known and the world is discrete with only a few types of objects".[2]

StarCraft II is a popular fast-paced online real-time strategy game developed by Blizzard Entertainment.[3][4]

History

DeepMind Technologies was founded in the UK in 2010. As early as 2011, founder Demis Hassabis called StarCraft "the next step up" after games like Go.[5] DeepMind became a subsidiary of Google in 2014, after demonstrating self-learning bots with superhuman ability at a variety of Atari 2600 games. In February 2015, computer scientist Zachary Mason predicted Deepmind's research "leads to StarCraft in five or ten years".[6] In March 2016, following AlphaGo's victory over Lee Sedol, a world champion Go player, Hassabis publicly mulled building an AI for StarCraft, citing it as a strategic game with incomplete information where, unlike Go, much of the "board" is invisible.[7][8] A formal collaboration was announced at BlizzCon in November 2016, alongside a plan to release an open development environment for bots in Q1 of 2017.[9]

By 2017, DeepMind was experimenting with feeding StarCraft data into its software. In August 2017, DeepMind and Blizzard released development tools to assist in bot development, as well as data from 65,000 historical games. At the time, computer scientist and StarCraft tournament manager David Churchill estimated it would take five years for a bot to beat a human, but made the caveat that AlphaGo had beaten expectations. In Wired, tech journalist Tom Simonite stated "No one expects the robot to win anytime soon. But when it does, it will be a far greater achievement than DeepMind's conquest of Go."[10]

In December 2018, DeepMind's bot defeated professional player Grzegorz "MaNa" Komincz, 5-0. DeepMind announced the bot, named "AlphaStar", in January 2019. A journalist at Ars Technica and others argued that AlphaStar still had unfair advantages: "AlphaStar has the ability to make its clicks with surgical precision using an API, whereas human players are constrained by the mechanical limits of computer mice". AlphaStar also had a global view rather than being limited by the in-game camera. Furthermore, while there was a cap on the number of actions over a five-second window, AlphaStar was free to allocate its action quota unevenly across the window in order to launch superhuman bursts of activity at critical moments. DeepMind quickly retrained AlphaStar under more realistic constraints, and then lost a rematch with Komincz.[11] Starting in July 2019, the new, constrained version of AlphaStar anonymously competed against players who "opted in" on the public 1v1 European multiplayer ladder.[12] By the end of August 2019, AlphaStar had attained Grandmaster level, ranking among the top 0.2% of human players.[13]

Algorithms

Unlike AlphaZero, AlphaStar initially learns to imitate the moves of the best players in its database of human vs. human games; this step is necessary to solve what DeepMind's Dave Silver calls "the exploration problem": discovering new strategies would otherwise be like finding a "needle in a haystack". Agents then play each other and deploy deep reinforcement learning. These main agents also learn by playing against suboptimal "exploiter agents" whose purpose is to expose weaknesses in the main agents.[14][15]

Reactions

After his 5-0 defeat in December 2018, Komincz stated "I wasn't expecting the AI to be that good".[16]

Stuart Russell assessed that AlphaStar's 2018 victory required "a fair amount of problem-specific effort" and that general-purpose methods were "not quite ready for StarCraft".[2]

An article in Wired UK judged AlphaStar's new constraints, adopted for the July 2019 matches, to be "fair" this time around.[17] StarCraft professional Raza "RazerBlader" Sekha stated AlphaStar was "impressive" but had its quirks, succumbing in one game to an unorthodox army composition made up of only air units. The UK's top player, Joshua "RiSky" Hayward, expressed some disappointment, saying AlphaStar "often didn't make the most efficient, strategic decisions".[14] Professional Diego "Kelazhur" Schwimer called AlphaStar's play "unimaginably unusual; it really makes you question how much of StarCraft's diverse possibilities pro players have really explored".[13] AlphaStar's opponents often did not realize they were playing a bot.[18]

Ian Sample, of The Guardian, called AlphaStar a "landmark achievement" for the field of AI.[19] Churchill stated that he had previously seen bots that master one or two elements of StarCraft, but that AlphaStar was the first that can handle the game in its entirety.[3] Gary Marcus expressed his continuing skepticism about deep learning, stating: "So far the field has struggled to take techniques like this out of the laboratory and game environments and into the real world, and I don't immediately see this result as progress in that direction".[14] AI researcher Jon Dodge was surprised by AlphaStar, stating that he did not expect such a "superhuman" performance for "another couple of years"; in contrast, Churchill states "StarCraft is nowhere near being 'solved', and AlphaStar is not yet even close to playing at a world champion level".[4]

Legacy

DeepMind argues that insights from AlphaStar might benefit robots, self-driving cars, and virtual assistants, which need to operate with "imperfectly observed information". Silver has indicated his lab "may rest at this point", rather than try to substantially improve AlphaStar.[14] Silver himself argues that "AlphaStar has become the first AI system to reach the top tier of human performance in any professionally played e-sport on the full unrestricted game under professionally approved conditions... Ever since computers cracked Go, chess, and poker, the game of StarCraft has emerged, essentially by consensus from the community, as the next grand challenge for AI."[19]

Computer scientist Noel Sharkey argues, disapprovingly, that "military analysts will certainly be eyeing the successful AlphaStar real-time strategies as a clear example of the advantages of AI for battlefield planning".[19] In contrast, Silver argues: "To say that this has any kind of military use is saying no more than to say an AI for chess could be used to lead to military applications".[14]

See also

References

  1. ^ Arulkumaran, Kai; Antoine, Cully; Togelius, Julian (July 2019). "AlphaStar: An evolutionary computation perspective". Proceedings of the Genetic and Evolutionary Computation Conference Companion. pp. 314–5. arXiv:1902.01724. doi:10.1145/3319619.3321894. ISBN 9781450367486. S2CID 59604439.
  2. ^ a b Russell, Stuart (8 October 2019). "Chapter 2: Intelligence in Humans and Machines". Human Compatible: Artificial Intelligence and the Problem of Control (Hardcover ed.). Viking. ISBN 978-0-525-55861-3.
  3. ^ a b Daley, Jason (30 October 2019). "A.I. Mastered Backgammon, Chess and Go. Now It Takes On StarCraft II". Smithsonian Magazine. Retrieved 26 February 2020.
  4. ^ a b Garisto, Dan (30 October 2019). "Google AI beats top human players at strategy game StarCraft II". Nature. doi:10.1038/d41586-019-03298-6. PMID 33116320. S2CID 208116679.
  5. ^ Cheng, Jonathan (22 April 2016). "Computers That Crush Humans at Games Might Have Met Their Match: 'StarCraft'". Wall Street Journal. Retrieved 26 February 2020.
  6. ^ Gibbs, Samuel (27 January 2014). "Google buys UK artificial intelligence startup Deepmind for £400m". The Guardian. Retrieved 26 February 2020.
  7. ^ Byford, Sam (10 March 2016). "DeepMind founder Demis Hassabis on how AI will shape the future". The Verge. Retrieved 26 February 2020.
  8. ^ "Google's Artificial Intelligence Project May Start Playing Video Games". Fortune. Retrieved 26 February 2020.
  9. ^ Byford, Sam (4 November 2016). "Google DeepMind's next gaming challenge: can AI beat StarCraft II?". The Verge. Retrieved 26 February 2020.
  10. ^ "Google DeepMind AI Declares Galactic War on StarCraft". Wired. 9 August 2017. Retrieved 26 February 2020.
  11. ^ Lee, Timothy B. (30 January 2019). "An AI crushed two human pros at StarCraft—but it wasn't a fair fight". Ars Technica. Retrieved 26 February 2020.
  12. ^ Amadeo, Ron (11 July 2019). "DeepMind AI is secretly lurking on the public StarCraft II 1v1 ladder". Ars Technica. Retrieved 26 February 2020.
  13. ^ a b Statt, Nick (30 October 2019). "DeepMind's StarCraft 2 AI is now better than 99.8 percent of all human players". The Verge. Retrieved 26 February 2020.
  14. ^ a b c d e Kelion, Leo (30 October 2019). "DeepMind claims landmark moment for AI in esports". BBC News. Retrieved 26 February 2020.
  15. ^ Vinyals, Oriol; Babuschkin, Igor; Czarnecki, Wojciech M.; et al. (30 October 2019). "Grandmaster level in StarCraft II using multi-agent reinforcement learning". Nature. 575 (7782): 350–354. Bibcode:2019Natur.575..350V. doi:10.1038/s41586-019-1724-z. PMID 31666705. S2CID 204972004.
  16. ^ Heaven, Douglas (21 August 2019). "Mind meld: Artificial intelligence is improving the way humans think". New Scientist. Retrieved 26 February 2020.
  17. ^ Lee, Alex (30 October 2019). "DeepMind has finally thrashed humans at StarCraft for real". Wired UK. Retrieved 26 February 2020.
  18. ^ "DeepMind claims breakthrough as AI masters StarCraft II game". Financial Times. 2019. Retrieved 26 February 2020.
  19. ^ a b c Sample, Ian (30 October 2019). "AI becomes grandmaster in 'fiendishly complex' StarCraft II". The Guardian. Retrieved 26 February 2020.

Read other articles:

Richard D. Adams

Richard Donald AdamsLahir(1909-06-14)14 Juni 1909Ambridge, PennsylvaniaMeninggal5 September 1987(1987-09-05) (umur 78)San Francisco, CaliforniaDikebumikanGolden Gate National CemeteryPengabdian Amerika SerikatDinas/cabang Angkatan Laut Amerika SerikatLama dinas1932-1965 [1]Pangkat Laksamana MudaKomandanNaval Reserve Sub-Repair Division 12-34 Naval Reserve (Surface) Brigade 12-2 Naval Reserve Group 12-6 (L) Perang/pertempuranPerang Dunia II •Kampanye Filipina •Pertem...

 

Mikoshi

Palanquin Shrine in Shinto A mikoshi of Hiyoshi-taisha. Mikoshi fighting on Nada-no-Kenka Matsuri at Himeji. This mikoshi enshrines Tokugawa Ieyasu at the Tōshō-gū in Nikkō A mikoshi (神輿) is a sacred religious palanquin (also translated as portable Shinto shrine). Shinto followers believe that it serves as the vehicle to transport a deity in Japan while moving between main shrine and temporary shrine during a festival or when moving to a new shrine. Often, the mikoshi resembles a mini...

 

Olivia Newton-John

DameOlivia Newton-JohnAC DBENewton-John pada tahun 1978Lahir(1948-09-26)26 September 1948Cambridge, InggrisMeninggal8 Agustus 2022(2022-08-08) (umur 73)Santa Ynez Valley, California, Amerika SerikatKebangsaanAustraliaBritaniaPekerjaanPenyanyiaktrisaktivisTahun aktif1963–2022Suami/istri Matt Lattanzi ​ ​(m. 1984; c. 1995)​ John Easterling ​(m. 2008)​ PasanganLee Kramer (1973–1979)AnakChloe LattanziKarie...

Government Polytechnic, Nagpur

21°9′48.46″N 79°4′59.5″E / 21.1634611°N 79.083194°E / 21.1634611; 79.083194 Government Polytechnic, NagpurGP Nagpur logoFormer namesGovernment Engineering SchoolTypePublic Government InstituteEstablished19 July 1914 (105 years ago)AffiliationAutonomous, AICTE, DTEChairmanG. R. Thakare (Joint Director, Technical Education, Regional Office, Nagpur)Students2670 Approx.LocationNear Mangalwari Bazaar, Sadar, Nagpur, Pin-440001, Maharashtra, IndiaCampusUrban 22 ...

 

Mibefradil

Withdrawn antihypertensive drug of the calcium channel blocker class MibefradilClinical dataTrade namesPosicorAHFS/Drugs.comMicromedex Detailed Consumer InformationMedlinePlusa607007Routes ofadministrationBy mouth (tablets)ATC codeC08CX01 (WHO) Legal statusLegal status Withdrawn from market Pharmacokinetic dataBioavailability70%Protein binding>99%MetabolismLiver (CYP3A4)Elimination half-life17–25 hoursIdentifiers IUPAC name (1S,2S)-2-(2-((3-(1H-benzo[d]imidazol-2-yl)propyl) (me...

 

George Freeman (politician)

British Conservative politician George FreemanMPOfficial portrait, 2020Minister of State for Science, Research and Innovation[a]In office26 October 2022 – 13 November 2023Prime MinisterRishi SunakPreceded byNusrat GhaniSucceeded byAndrew GriffithIn office17 September 2021 – 7 July 2022Prime MinisterBoris JohnsonPreceded byAmanda SollowaySucceeded byNusrat GhaniMinister of State for TransportIn office26 July 2019 – 13 February 2020Prime MinisterBoris Jo...

大字 (数字)

この項目には、一部のコンピュータや閲覧ソフトで表示できない文字が含まれています（詳細）。 数字の大字（だいじ）は、漢数字の一種。通常用いる単純な字形の漢数字（小字）の代わりに同じ音の別の漢字を用いるものである。 概要 壱万円日本銀行券（「壱」が大字） 弐千円日本銀行券（「弐」が大字） 漢数字には「一」「二」「三」と続く小字と、「壱」「�...

 

List of rivers of Burkina Faso

Map of Burkina Faso with main rivers This is a list of streams and rivers in Burkina Faso. Burkina Faso has three main rivers — the Black Volta, the Red Volta and the White Volta.[1] Areas near rivers are affected by tsetse flies and simulium flies.[1] This list is arranged by drainage basin, with respective tributaries indented under each larger stream's name. Gulf of Guinea The Volta river system Komoé River Iringou River Léraba River Volta River (Ghana) Oti River ...

 

Margrave

Military and noble title in medieval Europe For other uses, see Margrave (disambiguation). Markgraf redirects here. For other uses, see Markgraf (disambiguation). Part of a series onImperial, royal, noble,gentry and chivalric ranks in Europe Emperor, Empress dowager Tsar, Tsarina High king, High queen King consort dowager Queen regnant consort dowager mother Grand duke, Grand duchess Archduke, Archduchess Prince consort Princess consort Duke, Duchess Crown prince, Crown princess Jarl Prince-e...

Issa Ndoye

Artikel ini sebatang kara, artinya tidak ada artikel lain yang memiliki pranala balik ke halaman ini.Bantulah menambah pranala ke artikel ini dari artikel yang berhubungan atau coba peralatan pencari pranala.Tag ini diberikan pada November 2022. Issa Ndoye Informasi pribadiNama lengkap Issa NdoyeTanggal lahir 12 Desember 1985 (umur 38)Tempat lahir Touba Toul, Thiès, SenegalTinggi 2,02 m (6 ft 8 in)Posisi bermain Penjaga gawangInformasi klubKlub saat ini SpVgg Greuther Fü...

 

Crucifixion of Jesus

Jesus's death as described in the gospels The Crucifixion redirects here. For other uses, see Crucifixion (disambiguation). Death of Jesus redirects here. For other uses, see Death of Jesus (disambiguation). Crucifixion of JesusChrist Crucified (c. 1632) by Diego VelázquezDateAD 30/33LocationJerusalem, Judaea, Roman EmpireTypeExecution by crucifixionCauseCondemnation before Pilate's courtParticipantsRoman army (executioners)OutcomeMinistry of the apostlesEarliest persecution of Christi...

 

Slobodan Milošević

Slobodan MiloševićСлободан Милошевић Slobodan MiloševićSlobodan em 1988 Presidente da República Federal da Iugoslávia Período 23 de julho de 1997 a 5 de outubro de 2000 Antecessor(a) Zoran Lilić Sucessor(a) Vojislav Koštunica Presidente da Sérvia Período 8 de maio de 1989 a 23 de julho de 1997 Sucessor(a) Milan Milutinović Dados pessoais Nascimento 20 de agosto de 1941 Požarevac, Sérvia ocupada Morte 11 de março de 2006 (64 anos) Haia, Paíse...

コスモポリタン製菓

有限会社コスモポリタン製菓The Cosmopolitan Confectionery 神戸本店種類 有限会社市場情報 非上場本社所在地 日本〒650-0046神戸市中央区港島中町7丁目7-3設立 1969年業種 食料品事業内容 洋菓子の製造・販売代表者 代表取締役 ヴァレンティン・ヴァレンティノヴィチ・モロゾフ（閉業時）資本金 500万円売上高 15億円（2001年度）従業員数 67名（2002年4月）関係する人物 ヴァレン�...

 

Galibi, Suriname

Resort in Marowijne District, SurinameGalibiResortTurtle on the beach of GalibiMap showing the resorts of Marowijne District.  GalibiCoordinates: 5°41′52″N 54°01′40″W / 5.6978°N 54.0277°W / 5.6978; -54.0277Country SurinameDistrictMarowijne DistrictArea • Total1,014 km2 (392 sq mi)Elevation0 m (0 ft)Population (2012)[1] • Total741 • Density0.73/km2 (1.9/sq mi)Time z...

 

Hastings Banda

Not to be confused with Banda Sea. First president of Malawi His ExcellencyHastings Kamuzu Banda1st President of MalawiIn office6 July 1966 – 24 May 1994Preceded byElizabeth II as Queen of MalawiSucceeded byBakili MuluziPrime Minister of MalawiIn office6 July 1964 – 6 July 1966MonarchElizabeth IIGovernor‑GeneralSir Glyn Smallwood JonesPreceded byPost establishedSucceeded byHimself as President Personal detailsBornAkim Kamnkhwala Mtunthama Bandac. 1898Kasungu...

Warwick Castle

Medieval motte-and-bailey castle in Warwickshire, England This article is about the castle in Warwickshire. For the pub in London, see Warwick Castle, Maida Vale. Warwick CastleWarwick in EnglandWarwick Castle and the River AvonWarwick CastleShown within WarwickshireCoordinates52°16′46″N 01°35′05″W / 52.27944°N 1.58472°W / 52.27944; -1.58472Site informationOwnerLXi REITOperatorMerlin EntertainmentsOpen tothe public1978Websitewarwick-castle.co...

 

Geneva Open

Disambiguazione – Se stai cercando l'omonimo torneo del circuito Challenger, vedi Geneva Open Challenger. Geneva OpenAltri nomiGeneva Open (2015)Banque Eric Sturdza Geneva Open (2016-2019)Gonet Geneva Open (2020-2021) Sport Tennis CategoriaGrand Prix (1980-1989)ATP World Series (1990-1991)ATP Tour 250 (2015-) Paese Svizzera LuogoGinevra ImpiantoTC Genève SuperficieTerra rossa DirettoreThierry Grin CadenzaAnnuale Disciplinesingolare e doppio maschile Partecipanti32S/16Q/16D Sito Inter...

 

Grant (money)

Non-repayable funds disbursed by one party to a recipient This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these messages) This article may require cleanup to meet Wikipedia's quality standards. The specific problem is: Various grammar and organizational issues. Please help improve this article if you can. (June 2012) (Learn how and when to remove this message) This article relies excessively on references to prim...

Gentlemen, I Neglected to Inform You You Will Not Be Getting Paid

2009 studio album by Charlie HunterGentlemen, I Neglected to Inform You You Will Not Be Getting PaidStudio album by Charlie HunterReleased2009StudioBrooklyn RecordingGenreJazz, jazz rock, jazz fusion, bluesLength37:38LabelSpire/reapandsowProducerCharlie HunterCharlie Hunter chronology Baboon Strength(2008) Gentlemen, I Neglected to Inform You You Will Not Be Getting Paid(2009) Public Domain(2010) Professional ratingsReview scoresSourceRatingAllMusic [1] Gentlemen, I Neglected ...

 

Manfred Wörner

German politician and diplomat (1934–1994) This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Manfred Wörner – news · newspapers · books · scholar · JSTOR (February 2013) (Learn how and when to remove this message) Manfred Wörner7th Secretary General of NATOIn office1 July 1988 – 13 August 19...