Potential game

In game theory, a game is said to be a potential game if the incentive of all players to change their strategy can be expressed using a single global function called the potential function. The concept originated in a 1996 paper by Dov Monderer and Lloyd Shapley.[1]

The properties of several types of potential games have since been studied. Games can be either ordinal or cardinal potential games. In cardinal games, the difference in individual payoffs for each player from individually changing one's strategy, other things equal, has to have the same value as the difference in values for the potential function. In ordinal games, only the signs of the differences have to be the same.

The potential function is a useful tool to analyze equilibrium properties of games, since the incentives of all players are mapped into one function, and the set of pure Nash equilibria can be found by locating the local optima of the potential function. Convergence and finite-time convergence of an iterated game towards a Nash equilibrium can also be understood by studying the potential function.

Potential games can be studied as repeated games with state so that every round played has a direct consequence on game's state in the next round.[2] This approach has applications in distributed control such as distributed resource allocation, where players without a central correlation mechanism can cooperate to achieve a globally optimal resource distribution.

Definition

Let be the number of players, the set of action profiles over the action sets of each player and be the payoff function for player .

Given a game , we say that is a potential game with an exact (weighted, ordinal, generalized ordinal, best response) potential function if is an exact (weighted, ordinal, generalized ordinal, best response, respectively) potential function for . Here, is called

  • an exact potential function if ,
That is: when player switches from action to action , the change in the potential equals the change in the utility of that player.
  • a weighted potential function if there is a vector such that ,
That is: when a player switches action, the change in equals the change in the player's utility, times a positive player-specific weight. Every exact PF is a weighted PF with wi=1 for all i.
  • an ordinal potential function if ,
That is: when a player switches action, the sign of the change in equals the sign of the change in the player's utility, whereas the magnitude of change may differ. Every weighted PF is an ordinal PF.
  • a generalized ordinal potential function if ,
That is: when a player switches action, if the player's utility increases, then the potential increases (but the opposite is not necessarily true). Every ordinal PF is a generalized-ordinal PF.
  • a best-response potential function if ,
where is the best action for player given .

Note that while there are utility functions, one for each player, there is only one potential function. Thus, through the lens of potential functions, the players become interchangeable (in the sense of one of the definitions above). Because of this symmetry of the game, decentralized algorithms based on the shared potential function often lead to convergence (in some of sense) to a Nash equilibria.

A simple example

In a 2-player, 2-action game with externalities, individual players' payoffs are given by the function ui(ai, aj) = bi ai + w ai aj, where ai is players i's action, aj is the opponent's action, and w is a positive externality from choosing the same action. The action choices are +1 and −1, as seen in the payoff matrix in Figure 1.

This game has a potential function P(a1, a2) = b1 a1 + b2 a2 + w a1 a2.

If player 1 moves from −1 to +1, the payoff difference is Δu1 = u1(+1, a2) – u1(–1, a2) = 2 b1 + 2 w a2.

The change in potential is ΔP = P(+1, a2) – P(–1, a2) = (b1 + b2 a2 + w a2) – (–b1 + b2 a2w a2) = 2 b1 + 2 w a2 = Δu1.

The solution for player 2 is equivalent. Using numerical values b1 = 2, b2 = −1, w = 3, this example transforms into a simple battle of the sexes, as shown in Figure 2. The game has two pure Nash equilibria, (+1, +1) and (−1, −1). These are also the local maxima of the potential function (Figure 3). The only stochastically stable equilibrium is (+1, +1), the global maximum of the potential function.

+1 –1
+1 +b1+w, +b2+w +b1w, –b2w
–1 b1w, +b2w b1+w, –b2+w
Fig. 1: Potential game example
+1 –1
+1 5, 2 –1, –2
–1 –5, –4 1, 4
Fig. 2: Battle of the sexes
(payoffs)
+1 –1
+1 4 0
–1 –6 2
Fig. 3: Battle of the sexes
(potentials)

A 2-player, 2-action game cannot be a potential game unless

Potential games and congestion games

Exact potential games are equivalent to congestion games: Rosenthal[3] proved that every congestion game has an exact potential; Monderer and Shapley[1] proved the opposite direction: every game with an exact potential function is a congestion game.

Potential games and improvement paths

An improvement path (also called Nash dynamics) is a sequence of strategy-vectors, in which each vector is attained from the previous vector by a single player switching his strategy to a strategy that strictly increases his utility. If a game has a generalized-ordinal-potential function , then is strictly increasing in every improvement path, so every improvement path is acyclic. If, in addition, the game has finitely many strategies, then every improvement path must be finite. This property is called the finite improvement property (FIP). We have just proved that every finite generalized-ordinal-potential game has the FIP. The opposite is also true: every finite game has the FIP has a generalized-ordinal-potential function.[4][clarification needed] The terminal state in every finite improvement path is a Nash equilibrium, so FIP implies the existence of a pure-strategy Nash equilibrium. Moreover, it implies that a Nash equlibrium can be computed by a distributed process, in which each agent only has to improve his own strategy.

A best-response path is a special case of an improvement path, in which each vector is attained from the previous vector by a single player switching his strategy to a best-response strategy. The property that every best-response path is finite is called the finite best-response property (FBRP). FBRP is weaker than FIP, and it still implies the existence of a pure-strategy Nash equilibrium. It also implies that a Nash equlibrium can be computed by a distributed process, but the computational burden on the agents is higher than with FIP, since they have to compute a best-response.

An even weaker property is weak-acyclicity (WA).[5] It means that, for any initial strategy-vector, there exists a finite best-response path starting at that vector. Weak-acyclicity is not sufficient for existence of a potential function (since some improvement-paths may be cyclic), but it is sufficient for the existence of pure-strategy Nash equilibirum. It implies that a Nash equilibrium can be computed almost-surely by a stochastic distributed process, in which at each point, a player is chosen at random, and this player chooses a best-strategy at random.[4]

See also

References

  1. ^ a b Monderer, Dov; Shapley, Lloyd (1996). "Potential Games". Games and Economic Behavior. 14: 124–143. doi:10.1006/game.1996.0044.
  2. ^ Marden, J., (2012) State based potential games http://ecee.colorado.edu/marden/files/state-based-games.pdf
  3. ^ Rosenthal, Robert W. (1973), "A class of games possessing pure-strategy Nash equilibria", International Journal of Game Theory, 2: 65–67, doi:10.1007/BF01737559, MR 0319584, S2CID 121904640.
  4. ^ a b Milchtaich, Igal (1996-03-01). "Congestion Games with Player-Specific Payoff Functions". Games and Economic Behavior. 13 (1): 111–124. doi:10.1006/game.1996.0027. ISSN 0899-8256.
  5. ^ Young, H. Peyton (1993). "The Evolution of Conventions". Econometrica. 61 (1): 57–84. doi:10.2307/2951778. ISSN 0012-9682. JSTOR 2951778.
  6. ^ Voorneveld, Mark; Norde, Henk (1997-05-01). "A Characterization of Ordinal Potential Games". Games and Economic Behavior. 19 (2): 235–242. doi:10.1006/game.1997.0554. ISSN 0899-8256. S2CID 122795041.

Read other articles:

Civil parish in Alentejo, PortugalPonte de Sor, Tramaga e Vale de AçorCivil parishPonte de Sor, Tramaga e Vale de AçorLocation in PortugalCoordinates: 39°14′53″N 8°00′47″W / 39.248°N 8.013°W / 39.248; -8.013Country PortugalRegionAlentejoIntermunic. comm.Alto AlentejoDistrictPortalegreMunicipalityPonte de SorArea • Total331.71 km2 (128.07 sq mi)Population (2011) • Total11,198 • Density34/km2 (87/...

 

The King and IPoster promosiGenreDramaSejarahDitulis olehYoo Dong-yoonSutradaraKim Jae-hyung Lee Jong-soo Son Jae-sungPemeranOh Man-seok Ku Hye-sun Go Joo-wonNegara asalKorea SelatanJmlh. episode63ProduksiProduserYoon Young-mookPengaturan kameraMulti-cameraDurasiSenin dan Selasa pada pukul 21:55 (WSK)Rumah produksiOlive9Rilis asliJaringanSeoul Broadcasting SystemRilis27 Agustus 2007 (2007-08-27) –1 April 2008 (2008-4-1) The King and IHangul왕과 나 Hanja王과 나 Alih Aks...

 

Siklon SidrBadai siklon ekstrem (skala MD)Siklon tropis kategori 4 (SSHWS)Sidr di teluk BenggalaTerbentuk pada11 November 2007Mereda pada16 November 2007 Kecepatan anginmaksimal3 menit: 215 km/jam 1 menit: 250 km/jam Tekanan minimal944 hPa (mbar) Korban jiwa2,388Area terdampakBangladesh, India timurBagian dari Musim siklon Samudera Hindia Utara 2007 Siklon Sidr adalah nama keempat badai dari musim siklon Samudera Hindia Utara 2007. Pada pagi hari tanggal 15 November, angin bertiup dengan...

Danish-German organist and composer (1637–1707) Dieterich BuxtehudeThe only surviving portrait of Buxtehude, playing a viol, from Musical Company by Johannes Voorhout (1674)BornDiderich Hansen BuxtehudeHelsingborg, Scania, Denmark–NorwayBaptised1637Died9 May 1707(1707-05-09) (aged 69–70)Free City of Lübeck, Holy Roman EmpireOccupationsComposerorganistWorksList of compositionsSignature Dieterich Buxtehude (German: [ˈdiːtəʁɪç bʊkstəˈhuːdə]; born Diderich Hansen Bu...

 

Cet article est une ébauche concernant la météorologie ou la climatologie. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations des projets correspondants. Pour les articles homonymes, voir onde (homonymie). Une onde de Kelvin est une onde de gravité océanique, ou atmosphérique, de taille caractéristique assez grande pour que la force de Coriolis se fasse ressentir et en présence d'une couche limite (typiquement une côte). Physiquement...

 

1438 Edict of Charles VII of France limiting Papal authority in France Charles VII of France in a 1444 depiction. The Pragmatic Sanction of Bourges, issued by King Charles VII of France, on 7 July 1438,[1] required a General Church Council, with authority superior to that of the papacy, to be held every ten years,[2] required election rather than appointment to ecclesiastical offices,[3] prohibited the pope from bestowing and profiting from benefices, and forbade appea...

Komando Distrik Militer 0706/TemanggungLambang Korem 072/PamungkasNegara IndonesiaAliansiKorem 072/PMKCabangTNI Angkatan DaratTipe unitKodimPeranSatuan TeritorialBagian dariKodam IV/DiponegoroMakodimTemanggung, Kabupaten TemanggungJulukanKodim 0706PelindungTentara Nasional IndonesiaBaret H I J A U  Komando Distrik Militer 0706/Temanggung merupakan satuan kewilayahan yang berada dibawah kendali Korem 072/Pamungkas. Kodim 0706/Temanggung memiliki wilayah teritorial yang meliputi ...

 

French engineering school This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Supméca – news · newspapers · books · scholar · JSTOR (April 2009) (Learn how and when to remove this message) Supmeca ParisSupmécaOther nameInstitut supérieur de mécanique de ParisFormer nameCESTIEstablished1948Budget21 M€Direct...

 

Irish-bred Thoroughbred racehorse Kew GardensRacing silks of Mr Derrick SmithSireGalileoGrandsireSadler's WellsDamChelsea RoseDamsireDesert KingSexColtFoaled20 January 2015[1]CountryIrelandColourBayBreederBarronstown StudOwnerDerrick Smith, Sue Magnier & Michael TaborTrainerAidan O'BrienRecord17: 6-5-2Earnings£1,399,666Major winsZetland Stakes (2017)Queen's Vase (2018)Grand Prix de Paris (2018)St Leger (2018)British Champions Long Distance Cup (2019) Kew Gardens (foaled 20 Januar...

Cambodian politician (1932–2015) In this Cambodian name, the surname is Chea. In accordance with Cambodian custom, this person should be referred to by the given name, Sim. Samdech Akka Moha Thomma PothisalChea Simជា ស៊ីមSim in 2012President of the SenateIn office25 March 1999 – 8 June 2015MonarchsNorodom SihanoukNorodom SihamoniPreceded bySaukam Khoy (1972)Succeeded bySay ChhumPresident of the Cambodian People's PartyIn office17 October 1991 – 8 June 2015D...

 

Species of plant in the family Fabaceae Entada phaseoloides Pod specimen Conservation status Least Concern (NCA)[1] Scientific classification Kingdom: Plantae Clade: Tracheophytes Clade: Angiosperms Clade: Eudicots Clade: Rosids Order: Fabales Family: Fabaceae Subfamily: Caesalpinioideae Clade: Mimosoid clade Genus: Entada Species: E. phaseoloides Binomial name Entada phaseoloides(L.) Merr.[2] Synonyms[2] 20 synonyms Acacia scandens (L.) Willd.Acacia sulcata ...

 

Cabinet of Japan (July - December 1960) First Ikeda Cabinet58th Cabinet of JapanDate formedJuly 19, 1960Date dissolvedDecember 8, 1960People and organisationsEmperorShōwaPrime MinisterHayato IkedaMember partyLiberal Democratic PartyStatus in legislatureHouse of Representatives: MajorityHouse of Councillors: MajorityOpposition partiesJapan Socialist PartyJapanese Communist PartyRyokufūkaiHistoryLegislature term(s)35th-37th National DietPredecessorSecond Kishi CabinetSuccessorSecond Ikeda Cab...

本條目存在以下問題,請協助改善本條目或在討論頁針對議題發表看法。 此條目需要編修,以確保文法、用詞、语气、格式、標點等使用恰当。 (2013年8月6日)請按照校對指引,幫助编辑這個條目。(幫助、討論) 此條目剧情、虛構用語或人物介紹过长过细,需清理无关故事主轴的细节、用語和角色介紹。 (2020年10月6日)劇情、用語和人物介紹都只是用於了解故事主軸,輔助�...

 

See also: Allied Troop Movements During Operation Michael 1918 German offensive during World War I Operation MichaelPart of the German spring offensive in World War IEvolution of the front line during the battleDate21 March – 5 April 1918LocationNorthern FranceResult See Aftermath sectionTerritorialchanges Germans penetrate British lines up to 40 mi (64 km) while seizing 1,200 sq mi (3,100 km2) of territoryBelligerents  German Empire  British Empire  ...

 

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Burg-Reuland – news · newspapers · books · scholar · JSTOR (March 2013) (Learn how and when to remove this message) Municipality in German-speaking Community of Belgium, BelgiumBurg-ReulandMunicipality FlagCoat of armsLocation of Burg-Reuland Burg-ReulandLocati...

Vùng tự trị in Phần LanBản mẫu:SHORTDESC:Vùng tự trị in Phần LanÅlandAhvenanmaa (tiếng Phần Lan)Vùng tự trị CờHuy hiệuVị trí vùng tự trị Åland trên bản đồ Phần LanQuốc gia Phần LanTỉnh lịch sử ÅlandThủ phủ Mariehamn60°07′B 019°54′Đ / 60,117°B 19,9°Đ / 60.117; 19.900Chính quyền • KiểuChính quyền tự trị được trao quyền • Quản lýChính phủ Ål...

 

ESPNDiluncurkan7 September 1979PemilikThe Walt Disney Company (80%)Hearst Corporation (20%)Kantor pusatBristol, Connecticut, Amerika SerikatKetersediaan SatelitDirecTV206Dish Network140 (SD)9424 (HD) ESPN (Entertainment and Sports Programming Network) adalah salah satu televisi kabel olahraga pertama di dunia yang didirikan oleh Scott Rasmussen dan Bill Rasmussen. Sejarah ESPN ESPN berdiri pada 7 September 1979 dengan siaran perdana mereka, adalah Sports Center. Setelah itu ESPN membuat beber...

 

Rapid and hot oxidation of a material For other uses, see Fire (disambiguation). This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed.Find sources: Fire – news · newspapers · books · scholar · JSTOR (April 2023) (Learn how and when to remove this message) A burning candle Fire is the rapid oxidation of a material (the fuel) in...

今池駅 2番出入口 いまいけ Imaike 所在地 名古屋市千種区今池五丁目1北緯35度10分11.5秒 東経136度56分14秒 / 北緯35.169861度 東経136.93722度 / 35.169861; 136.93722座標: 北緯35度10分11.5秒 東経136度56分14秒 / 北緯35.169861度 東経136.93722度 / 35.169861; 136.93722所属事業者 名古屋市交通局(名古屋市営地下鉄)駅構造 地下駅ホーム 各1面2線(計2面4線)乗車�...

 

نهر سان خوان (نيكاراغوا) نهر سان خوان (نيكاراغوا) المنطقة البلد نيكاراغوا  الخصائص الطول 180 كم (110 ميل) المجرى المنبع الرئيسي بحيرة نيكاراغوا المصب البحر الكاريبي  مساحة الحوض 35000 كيلومتر مربع  الجغرافيا دول الحوض نيكاراغوا، كوستاريكا بحيرات على النهر بحيرة نيكار�...