Stochastic games with endogenous transitions

Reinoud A.M.G. Joosten, Robin Meijboom

Research output: Book/Report › Report › Other research output

40 Downloads (Pure)

Abstract

We introduce a stochastic game in which transition probabilities depend on the history of the play, i.e., the players' past action choices. To solve this new type of game under the limiting average reward criterion, we determine the set of jointly-convergent pure-strategy rewards which can be supported by equilibria involving threats. We examine the following setting for motivational and expository purposes. Each period, two agents exploiting a fishery choose between catching with restraint or without. The fish stock is in either of two states, High or Low, and in the latter each action pair yields lower payoffs. Restraint is harmless to the fish, but it is a dominated strategy in each stage game. Absence of restraint damages the resource, i.e., the less restraint the agents show, the higher the probablities that Low occurs at the next stage of the play. This state may even become 'absorbing', i.e., transitions to High become impossible.
Original languageEnglish
Place of PublicationJena, Germany
PublisherMax Planck Gesellschaft
Number of pages29
Publication statusPublished - Nov 2010

Publication series

NamePapers on economics & evolution, ISSN 1430-4716
PublisherMax Planck Gesellschaft
No.2010-24

Fingerprint

Fish
Reward
Stochastic games
Threat
Fisheries
Damage
Transition probability
Resources
Pure strategies

Keywords

  • IR-76562
  • common pool resource dilemma
  • Equilibria
  • Stochastic games
  • endogenous transitions
  • limiting average rewards

Cite this

Joosten, R. A. M. G., & Meijboom, R. (2010). Stochastic games with endogenous transitions. (Papers on economics & evolution, ISSN 1430-4716; No. 2010-24). Jena, Germany: Max Planck Gesellschaft.
Joosten, Reinoud A.M.G. ; Meijboom, Robin. / Stochastic games with endogenous transitions. Jena, Germany : Max Planck Gesellschaft, 2010. 29 p. (Papers on economics & evolution, ISSN 1430-4716; 2010-24).
@book{05a7ecf771dc4f9c897de1b8e6acab00,
title = "Stochastic games with endogenous transitions",
abstract = "We introduce a stochastic game in which transition probabilities depend on the history of the play, i.e., the players' past action choices. To solve this new type of game under the limiting average reward criterion, we determine the set of jointly-convergent pure-strategy rewards which can be supported by equilibria involving threats. We examine the following setting for motivational and expository purposes. Each period, two agents exploiting a fishery choose between catching with restraint or without. The fish stock is in either of two states, High or Low, and in the latter each action pair yields lower payoffs. Restraint is harmless to the fish, but it is a dominated strategy in each stage game. Absence of restraint damages the resource, i.e., the less restraint the agents show, the higher the probablities that Low occurs at the next stage of the play. This state may even become 'absorbing', i.e., transitions to High become impossible.",
keywords = "IR-76562, common pool resource dilemma, Equilibria, Stochastic games, endogenous transitions, limiting average rewards",
author = "Joosten, {Reinoud A.M.G.} and Robin Meijboom",
year = "2010",
month = "11",
language = "English",
series = "Papers on economics & evolution, ISSN 1430-4716",
publisher = "Max Planck Gesellschaft",
number = "2010-24",

}

Joosten, RAMG & Meijboom, R 2010, Stochastic games with endogenous transitions. Papers on economics & evolution, ISSN 1430-4716, no. 2010-24, Max Planck Gesellschaft, Jena, Germany.

Stochastic games with endogenous transitions. / Joosten, Reinoud A.M.G.; Meijboom, Robin.

Jena, Germany : Max Planck Gesellschaft, 2010. 29 p. (Papers on economics & evolution, ISSN 1430-4716; No. 2010-24).

Research output: Book/Report › Report › Other research output

TY - BOOK

T1 - Stochastic games with endogenous transitions

AU - Joosten, Reinoud A.M.G.

AU - Meijboom, Robin

PY - 2010/11

Y1 - 2010/11

N2 - We introduce a stochastic game in which transition probabilities depend on the history of the play, i.e., the players' past action choices. To solve this new type of game under the limiting average reward criterion, we determine the set of jointly-convergent pure-strategy rewards which can be supported by equilibria involving threats. We examine the following setting for motivational and expository purposes. Each period, two agents exploiting a fishery choose between catching with restraint or without. The fish stock is in either of two states, High or Low, and in the latter each action pair yields lower payoffs. Restraint is harmless to the fish, but it is a dominated strategy in each stage game. Absence of restraint damages the resource, i.e., the less restraint the agents show, the higher the probablities that Low occurs at the next stage of the play. This state may even become 'absorbing', i.e., transitions to High become impossible.

AB - We introduce a stochastic game in which transition probabilities depend on the history of the play, i.e., the players' past action choices. To solve this new type of game under the limiting average reward criterion, we determine the set of jointly-convergent pure-strategy rewards which can be supported by equilibria involving threats. We examine the following setting for motivational and expository purposes. Each period, two agents exploiting a fishery choose between catching with restraint or without. The fish stock is in either of two states, High or Low, and in the latter each action pair yields lower payoffs. Restraint is harmless to the fish, but it is a dominated strategy in each stage game. Absence of restraint damages the resource, i.e., the less restraint the agents show, the higher the probablities that Low occurs at the next stage of the play. This state may even become 'absorbing', i.e., transitions to High become impossible.

KW - IR-76562

KW - common pool resource dilemma

KW - Equilibria

KW - Stochastic games

KW - endogenous transitions

KW - limiting average rewards

M3 - Report

T3 - Papers on economics & evolution, ISSN 1430-4716

BT - Stochastic games with endogenous transitions

PB - Max Planck Gesellschaft

CY - Jena, Germany

ER -

Joosten RAMG, Meijboom R. Stochastic games with endogenous transitions. Jena, Germany: Max Planck Gesellschaft, 2010. 29 p. (Papers on economics & evolution, ISSN 1430-4716; 2010-24).

Access to Document