Perturbation theory and finite Markov chains
From MaRDI portal
Publication:5592699
DOI10.2307/3212261zbMath0196.19803OpenAlexW2132775962WikidataQ110953024 ScholiaQ110953024MaRDI QIDQ5592699
Publication date: 1968
Published in: Journal of Applied Probability (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.2307/3212261
Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Continuous-time Markov processes on discrete state spaces (60J27)
Related Items (only showing first 100 items - show all)
Sensitivity of Steady States in Networks with Application to Markov Chains and Chemical Reaction Networks ⋮ Perturbation and Inverse Problems of Stochastic Matrices ⋮ Perturbation bounds for quantum Markov processes and their fixed points ⋮ On Perturbation Bounds for the Joint Stationary Distribution of Multivariate Markov Chain Models ⋮ The Role of Kemeny's Constant in Properties of Markov Chains ⋮ Comparison of perturbation bounds for the stationary distribution of a Markov chain ⋮ A Structured Condition Number for Kemeny's Constant ⋮ Unnamed Item ⋮ Convergence of Simulated Annealing with Feedback Temperature Schedules ⋮ Sharp Entrywise Perturbation Bounds for Markov Chains ⋮ Smoothed Functional Algorithms for Stochastic Optimization Using q -Gaussian Distributions ⋮ Perturbation results for nearly uncoupled Markov chains with applications to iterative methods ⋮ Response operators for Markov processes in a finite state space: radius of convergence and link to the response theory for axiom A systems ⋮ Variational characterizations in Markov decision processes ⋮ The Condition of a Finite Markov Chain and Perturbation Bounds for the Limiting Probabilities ⋮ On the long-run sensitivity of probabilistic Boolean networks ⋮ Stationary distributions of perturbed Markov chains ⋮ The group inverse of finite homogeneous QBD processes ⋮ Strong bounds on perturbations ⋮ Optimality equations and sensitive optimality in bounded Markov decision processes1 ⋮ Approximating physical invariant measures of mixing dynamical systems in higher dimensions ⋮ A functional approximation for the M/G/1/N queue ⋮ Multiscale Q-learning with linear function approximation ⋮ Perturbed Markov Processes ⋮ Algorithms for stochastic games ? A survey ⋮ General Solution of the Poisson Equation for Quasi-Birth-and-Death Processes ⋮ Modelling adherence behaviour for the treatment of obstructive sleep apnoea ⋮ Using the QR Factorization and Group Inversion to Compute, Differentiate, and Estimate the Sensitivity of Stationary Probabilities for Markov Chains ⋮ On truncations and perturbations of Markov decision problems with an application to queueing network overflow control ⋮ A parametric uncertainty analysis method for queues with vacations ⋮ On regularly perturbed fundamental matrices ⋮ Finite state dynamic programming with the total reward criterion ⋮ The perturbation bound for the Perron vector of a transition probability tensor ⋮ Perturbation analysis of waiting times in the G/G/1 queue ⋮ Acute perturbation of the group inverse ⋮ Optimization of Markov decision processes under the variance criterion ⋮ A stability criterion for two timescale stochastic approximation schemes ⋮ Spread of (mis)information in social networks ⋮ Geometric ergodicity in a weighted Sobolev space ⋮ Drivers of diversity in individual life courses: sensitivity of the population entropy of a Markov chain ⋮ Nonstationary Markov decision problems with converging parameters ⋮ An actor-critic algorithm with function approximation for discounted cost constrained Markov decision processes ⋮ Variance-constrained actor-critic algorithms for discounted and average reward MDPs ⋮ Robust power series algorithm for epistemic uncertainty propagation in Markov chain models ⋮ Sensitivity analysis of discrete Markov chains via matrix calculus ⋮ Quasi-stationary asymptotics for perturbed semi-Markov processes in discrete time ⋮ Perturbations of countable Markov chains and processes ⋮ Ordinary Differential Equation Methods for Markov Decision Processes and Application to Kullback--Leibler Control Cost ⋮ Analytic approximations of queues with lightly- and heavily-correlated autoregressive service times ⋮ GSNs: generative stochastic networks ⋮ Time-homogeneous birth-death processes with probability intervals and absorbing state ⋮ Stochastic control via direct comparison ⋮ A perturbation analysis of Markov chains models with time-varying parameters ⋮ Nonlinearly perturbed regenerative processes and pseudo-stationary phenomena for stochastic systems ⋮ Error bounds on practical approximation for two tandem queue with blocking and non-preemptive priority ⋮ Optimal control of Markov chains admitting strong and weak interactions ⋮ The set of limiting distributions for a Markov chain with fuzzy transition probabilities ⋮ An online actor-critic algorithm with function approximation for constrained Markov decision processes ⋮ Perturbation analysis of the \(\mathrm{GI}/\mathrm{M}/s\) queue ⋮ LU decomposition of M-matrices by elimination without pivoting ⋮ Perturbation bounds for Markov chains with general state space ⋮ Asymptotics for Quasi-stationary Distributions of Perturbed Discrete Time Semi-Markov Processes ⋮ Asymptotic Expansions for Stationary Distributions of Perturbed Semi-Markov Processes ⋮ Unnamed Item ⋮ Analysis of Markov Influence Graphs ⋮ Simultaneous recurrent conditions on countable state Markov chains ⋮ An Approximation to the Stationary Distribution of a Nearly Completely Decomposable Markov Chain and Its Error Analysis ⋮ Generalized inverses of Markovian kernels in terms of properties of the Markov chain ⋮ Singulary perturbed Markov control problem: Limiting average cost ⋮ The first Laurent series coefficients for singularly perturbed stochastic matrices ⋮ Fuzzy optimality relation for perceptive MDPs-the average case ⋮ Perturbation analysis of continuous‐time absorbing Markov chains ⋮ Error bounds for state space truncation of finite Jackson networks ⋮ Ergodic theory for controlled Markov chains with stationary inputs ⋮ On optimal condition numbers for Markov chains ⋮ Optimal linear responses for Markov chains and stochastically perturbed dynamical systems ⋮ Quasi-Newton smoothed functional algorithms for unconstrained and constrained simulation optimization ⋮ A special stochastic decision problem ⋮ Stationary and structural control in gene regulatory networks: basic concepts ⋮ Opinion dynamics and learning in social networks ⋮ New perturbation bounds for denumerable Markov chains ⋮ Mixing times with applications to perturbed Markov chains ⋮ A Maclaurin-series expansion approach to multiple paired queues ⋮ Perturbation models ⋮ Asymptotic expansions for stationary distributions of nonlinearly perturbed semi-Markov processes. I. ⋮ Foolproof convergence in multichain policy iteration ⋮ On the chance to visit a goal set infinitely often ⋮ Coevolutionary systems and PageRank ⋮ Development of computational algorithm for multiserver queue with renewal input and synchronous vacation ⋮ Perturbation theory for games in normal form and stochastic games ⋮ Sensitivity of finite Markov chains under perturbation ⋮ Corrigendum to: ``Heavy-traffic asymptotics for stationary \(\mathrm{GI}/\mathrm{G}/1\)-type Markov chains ⋮ On the functional equations in undiscounted and sensitive discounted stochastic games ⋮ Stationary distribution and perturbation bounds for a stochastic inventory model ⋮ Robust Sensitivity Analysis for Stochastic Systems ⋮ Updating finite markov chains by using techniques of group matrix inversion ⋮ Single sample path-based optimization of Markov chains ⋮ Error bounds for nonnegative dynamic models ⋮ A Liapounov bound for solutions of the Poisson equation ⋮ Response and sensitivity using Markov chains
This page was built for publication: Perturbation theory and finite Markov chains
