Analysis of an identification algorithm arising in the adaptive estimation of Markov chains
From MaRDI portal
Publication:1262282
DOI10.1007/BF02551353zbMath0685.93063OpenAlexW2324831421WikidataQ60167569 ScholiaQ60167569MaRDI QIDQ1262282
Aristotle Arapostathis, Steven I. Marcus
Publication date: 1990
Published in: MCSS. Mathematics of Control, Signals, and Systems (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/bf02551353
Adaptive control/observation systems (93C40) Estimation and detection in stochastic control theory (93E10) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)
Related Items
Multilevel estimation of normalization constants using ensemble Kalman-Bucy filters ⋮ On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes ⋮ Exponential forgetting and geometric ergodicity for optimal filtering in general state-space models ⋮ \(L^{1}\)-convergence of smoothing densities in non-parametric state space models ⋮ On the adaptive control of a class of partially observed Markov decision processes ⋮ Transportation inequalities for hidden Markov chains and applications ⋮ Gradient free parameter estimation for hidden Markov models with intractable likelihoods ⋮ Unnamed Item
Cites Work
- Unnamed Item
- Unnamed Item
- Convergence results for continuous-time adaptive stochastic filtering algorithms
- Optimal adaptive control of priority assignment in queueing systems
- Adaptive control of service in queueing systems
- Théorèmes de convergence presque sure pour une classe d'algorithmes stochastiques à pas decroissant
- Non-negative matrices and Markov chains. 2nd ed
- Stochastic approximation with discontinuous dynamics and state dependent noise: w.p. 1 and weak convergence
- A limit theorem for partially observed Markov chains
- Stochastic approximation methods for constrained and unconstrained systems
- A limit theorem for Markov chains in compact metric spaces with applications to products of random matrices
- Optimal control of Markov processes with incomplete state information
- An Invariant Measure Approach to the Convergence of Stochastic Approximations with State Dependent Noise
- The average-optimal adaptive control of a Markov renewal model in presence of an unknown parameter
- A Survey of Some Results in Stochastic Adaptive Control
- Estimation and control in discounted stochastic dynamic programming
- A general Martingale approach to discrete-time stochastic control and estimation
- Discrete-time multivariable adaptive control
- Stochastic control of two partially observed competing queues
- Gradient approach for recursive estimation and control in finite Markov chains
- Products of Random Matrices
- Identification of a transition matrix of a Markov chain from noisy measurements of state
