Semicontinuous nonstationary stochastic games
type: Item
instance of: scholarly article
title: Semicontinuous nonstationary stochastic games
zbMATH Open document ID: 0594.90105
DOI: 10.1016/0022-247X(86)90250-7
published in: Journal of Mathematical Analysis and Applications
publication date: 1986-01-01T00:00:00Z
review text: A zero-sum discrete-time infinite horizon stochastic game with metric state spaces and compact (separable) metric action spaces for player II (I). The payoff for player I is a lower semicontinuous function on the space of all plays of the game. The transition law is nonstationary and consists of a sequence of weakly continuous transition probabilities associating with each n-stage history of the game a probability distribution of the \((n+1)st\) state. Such a stochastic game is a generalization of semicontinuous discounted and positive Markov games studied for the first time by \textit{A. Maitra} and \textit{T. Parthasarathy} [J. Optimization Theory Appl. 5, 289-300 (1970; Zbl 0181.232), and ibid. 8, 154-160 (1971; Zbl 0206.492)] and subsequently by \textit{T. Parthasarathy} [Int. J. Game Theory 2, 25-37 (1973; Zbl 0368.90139)], \textit{P. R. Kumar} and \textit{T. H. Shiau} [SIAM J. Control Optimization 19, 617-634 (1981; Zbl 0474.93053)] and \textit{U. Rieder} [On semicontinuous dynamic games, Preprint, University of Karlsruhe (1978)]. It is shown that such a game has a value and player II has an optimal strategy. This generalizes an earlier result of the author [Proc. Am. Math. Soc. 92, 418-424 (1984; Zbl 0559.90103)] where the state and action spaces are assumed to be countable sets. An alternative approach to zero-sum nonstationary stochastic games, where the payoff function (transition law) is semicontinuous (strongly continuous), but with respect to the actions of player II only, is taken in a recent report of the author [''A Borel space framework for zero-sum nonstationary stochastic games, Preprint, Wrocław Tech. Univ., Poland (1986)].
Mathematics Subject Classification ID: 91A15
Mathematics Subject Classification ID: 91A60
Mathematics Subject Classification ID: 93C55
zbMATH DE Number: 3956858
zbMATH Keywords: zero-sum discrete-time infinite horizon stochastic game
zbMATH Keywords: metric state spaces
author: Andrzej S. Nowak
MaRDI profile type: Publication
cites work: Q4606219
cites work: Q5722776
cites work: Stochastic optimal control. The discrete time case
cites work: Stochastic games with metric state space
cites work: Measurable sets of measures
cites work: Q5540233
cites work: Minimax Theorems
cites work: Measurable relations
cites work: Multifunctions with values in a space of probability measures
cites work: Q5599448
cites work: Persistently optimal plans for nonstationary dynamic programming: The topology of weak convergence case
cites work: Existence of Value and Randomized Strategies in Zero-Sum Discrete-Time Stochastic Dynamic Games
cites work: On stochastic games
cites work: On stochastic games. II
cites work: Q5509984
cites work: Approximation Theorems for Zero-Sum Nonstationary Stochastic Games
cites work: Universally measurable strategies in zero-sum stochastic games
cites work: Q5533878
cites work: Discounted, positive, and noncooperative stochastic games
cites work: Bayesian dynamic programming
cites work: Measurable selection theorems for optimization problems
cites work: Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
cites work: On dynamic programming: Compactness of the space of policies
cites work: Q3931025
cites work: Q3919479
cites work: Q3931056
cites work: Lower semicontinuous stochastic games with imperfect information
cites work: Stochastic Games
description: scientific article; zbMATH DE number 3956858