Markov Chains and Stochastic Stability

Introductory exposition (textbooks, tutorial papers, etc.) pertaining to probability theory (60-01) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Stochastic stability in control theory (93E15) Continuous-time Markov processes on discrete state spaces (60J27)

Related Items

Multiplicative ergodicity of Laplace transforms for additive functional of Markov chains, Risk-Sensitive Average Optimality for Discrete-Time Markov Decision Processes, Exponential ergodicity for a stochastic two-layer quasi-geostrophic model, A Model of Seasonal Savanna Dynamics, Convergence of nonequilibrium Langevin dynamics for planar flows, State estimation for aoristic models, Epicasting: an ensemble wavelet neural network for forecasting epidemics, Stability of a cascade system with two stations and its extension for multiple stations, Advanced Multilevel Monte Carlo Methods, Limit theorems for quantum trajectories, Gradient walks and $p$-harmonic functions, Exponential ergodicity of a degenerate age-size piecewise deterministic process, Subgroup‐adaptive randomization for subgroup confirmation in clinical trials, On the ergodic control of ensembles in the presence of non-linear filters, Ergodicity of supercritical SDEs driven by $\alpha $-stable processes and heavy-tailed sampling, Spectral gaps and error estimates for infinite-dimensional Metropolis-Hastings with non-Gaussian priors, Stochastic and statistical stability of the classical Lorenz flow under perturbations modeling anthropogenic type forcing, The generalized join the shortest orbit queue system: stability, exact tail asymptotics and stationary approximations, Expanding measures: Random walks and rigidity on homogeneous spaces, Hoeffding's inequality for non-irreducible Markov models, Exponential mixing for random dynamical systems and an example of Pierrehumbert, Matrix-Analytic Methods for Solving Poisson’s Equation with Applications to Markov Chains of GI/G/1-Type, Strong feller and ergodic properties of the (1+1)-affine process, Adaptive control of T-S fuzzy systems with Markov switching parameters through observer-based sliding mode approach, Shrinkage with shrunken shoulders: Gibbs sampling shrinkage model posteriors with guaranteed convergence rates, Recent Results on Recurrent Solutions and Limit Distributions of SDEs, Sample-path large deviations for a class of heavy-tailed Markov-additive processes, A non‐conservative Harris ergodic theorem, Time-reversal of multiple-force-point chordal $\mathrm{SLE}_{\kappa} (\underline{\rho})$, Speed up Zig-Zag, Stability of overshoots of Markov additive processes, Dimension‐independent Markov chain Monte Carlo on the sphere, Computable bounds of exponential moments of simultaneous hitting time for two time-inhomogeneous atomic Markov chains, A New and Unified Family of Covariate Adaptive Randomization Procedures and Their Properties, Full classification of dynamics for one-dimensional continuous-time Markov chains with polynomial transition rates, Random splitting of fluid models: unique ergodicity and convergence, Stability of a cascade system with multiple stations, Transform MCMC schemes for sampling intractable factor copula models, General criteria for the study of quasi-stationarity, Harnack inequalities and Gaussian estimates for random walks on metric measure spaces, On a Finite-Size Neuronal Population Equation, Layered networks, equilibrium dynamics, and stable coalitions, Correction to: ``Layered networks, equilibrium dynamics, and stable coalitions, Explicit bounds for spectral theory of geometrically ergodic Markov kernels and applications, Lower bounds from fitness levels made easy, The impacts of unobserved covariates on covariate-adaptive randomized experiments, Efficient shape-constrained inference for the autocovariance sequence from a reversible Markov chain, Online Bootstrap Inference For Policy Evaluation In Reinforcement Learning, On the Least Squares Estimation of Multiple-Threshold-Variable Autoregressive Models, Wasserstein contraction and Poincaré inequalities for elliptic diffusions with high diffusivity, Quasi-stationary behavior for a piecewise deterministic Markov model of chemostat: the Crump-Young model, Risk-sensitive first passage stochastic games with unbounded costs, Exact convergence analysis for metropolis–hastings independence samplers in Wasserstein distances, Randomness versus quasi-periodicity, Unnamed Item, Unnamed Item, Continuous-time Random Walks for the Numerical Solution of Stochastic Differential Equations, On the Return Time for a Reflected Fractional Brownian Motion Process on the Positive Orthant, Undiscounted Markov Chain BSDEs to Stopping Times, Markov Systems in a General State Space, Partial differential equations and stochastic methods in molecular dynamics, Hastings-Metropolis algorithm on Markov chains for small-probability estimation, Quantitative bounds of convergence for geometrically ergodic Markov chain in the Wasserstein distance with application to the Metropolis adjusted Langevin algorithm, Bayesian computation: a summary of the current state, and samples backwards and forwards, On the Minimum Pair Approach for Average Cost Markov Decision Processes with Countable Discrete Action Spaces and Strictly Unbounded Costs, Unnamed Item, Unnamed Item, Unnamed Item, Unnamed Item, Subgeometric rates of convergence for Markov processes under subordination, Exponential ergodicity of an affine two-factor model based on the α-root process, Typical representatives of free homotopy classes in multi-punctured plane, Approximations of Countably Infinite Linear Programs over Bounded Measure Spaces, Poisson's Equation in Nonlinear Filtering, Principal Eigenvalues of Generalized Convolution Operators on the Circle and Spreading Speeds of Noncompact Evolution Systems in Periodic Media, Convergence of the Random Batch Method for Interacting Particles with Disparate Species and Weights, Bayesian Inverse Problems and Kalman Filters, Similarity-based model for ordered categorical data, Some notes on nonlinear cointegration: A partial review with some novel perspectives, Convergence of the Wang-Landau algorithm, Concentration of Contractive Stochastic Approximation and Reinforcement Learning, Regenerative Simulation for Queueing Networks with Exponential or Heavier Tail Arrival Distributions, On the Marginal Standard Error Rule and the Testing of Initial Transient Deletion Methods, A mixture autoregressive model based on Student’s t–distribution, Extremal linkage networks, Central limit theorem and self-normalized Cramér-type moderate deviation for Euler-Maruyama scheme, An adaptive multiple-try Metropolis algorithm, Parameter estimation for threshold Ornstein-Uhlenbeck processes from discrete observations, Stability condition of a cascade system with a general number of stations, Convergence of constant step stochastic gradient descent for non-smooth non-convex functions, Stability-constrained Markov decision processes using MPC, Regime switching optimal growth model with risk sensitive preferences, Stationary distributions and ergodicity of reflection-type Markov chains, Generalized couplings and ergodic rates for SPDEs and other Markov models, Practical criteria for $R$-positive recurrence of unbounded semigroups, Existence of a unique quasi-stationary distribution in stochastic reaction networks, Geometric ergodicity in a weighted Sobolev space, On long-term arbitrage opportunities in Markovian models of financial markets, On the exchange of intersection and supremum of ${\sigma}$-fields in filtering theory, Unbiased Markov chain Monte Carlo for intractable target distributions, Bridging the gap between constant step size stochastic gradient descent and Markov chains, Importance sampling correction versus standard averages of reversible MCMCs in terms of the asymptotic variance, On the convergence of nonlinear Markov chains, Analytic approximations of queues with lightly- and heavily-correlated autoregressive service times, $\varepsilon$-strong simulation of the convex minorants of stable processes and meanders, Non-explosion by Stratonovich noise for ODEs, Stochastic stability of the classical Lorenz flow under impulsive type forcing, A perturbation analysis of Markov chains models with time-varying parameters, PAC-Bayesian estimation and prediction in sparse additive models, Join the shortest queue among $k$ parallel queues: tail asymptotics of its stationary distribution, On sub-geometric ergodicity of diffusion processes, Discrete-time control with non-constant discount factor, Sampling online social networks by random walk with indirect jumps, Self-excited hysteretic negative binomial autoregression, Asymptotic analysis of queueing models based on synchronization method, Regenerativity of Viterbi process for pairwise Markov models, Inverse problems for ergodicity of Markov chains, Robust nonlinear regression estimation in null recurrent time series, Correction to a proposition related to ergodicity of Markov chains, Note on local mixing techniques for stochastic differential equations, Stable limits for Markov chains via the principle of conditioning, On the limitations of single-step drift and minorization in Markov chain convergence analysis, Convergence of metadynamics: discussion of the adiabatic hypothesis, Staircase patterns in words: subsequences, subwords, and separation number, Sub-exponential rate of convergence to equilibrium for processes on the half-line, A simple microstructure model based on the Cox-BESQ process with application to optimal execution policy, On the rate of convergence to equilibrium for reflected Brownian motion, The expected time to cross a threshold and its determinants: a simple and flexible framework, Iterating Brownian motions, ad libitum, Irreducibility and geometric ergodicity of Hamiltonian Monte Carlo, Reactive trajectories and the transition path process, Deviation matrix and asymptotic variance for $\mathrm{GI}/\mathrm{M}/1$-type Markov chains, On the periodicity of non-homogeneous Markov chains and systems, The tail empirical process of regularly varying functions of geometrically ergodic Markov chains, Feasible generalized least squares estimation of multivariate GARCH(1,1) models, A noise-induced transition in the Lorenz system, Stability of equilibrium asset pricing models: a necessary and sufficient condition, A continuous-time stochastic model of cell motion in the presence of a chemoattractant, Flexible bivariate Poisson integer-valued GARCH model, Doeblin trees, Exponential ergodicity and convergence for generalized reflected Brownian motion, A note on jump Atlas models, Moment analysis of stochastic hybrid systems using semidefinite programming, Coevolutionary systems and PageRank, Metropolis-Hastings reversiblizations of non-reversible Markov chains, Asymptotics of maximum likelihood estimators based on Markov chain Monte Carlo methods, Exponential forgetting of smoothing distributions for pairwise Markov models, Convergence to quasi-stationarity through Poincaré inequalities and Bakry-Émery criteria, General-order observation-driven models: ergodicity and consistency of the maximum likelihood estimator, Recurrence of multidimensional persistent random walks. Fourier and series criteria, Subgeometric rates of convergence for discrete-time Markov chains under discrete-time subordination, Statistical inference for heavy tailed series with extremal independence, Ergodic behavior of non-conservative semigroups via generalized Doeblin's conditions, On a family of critical growth-fragmentation semigroups and refracted Lévy processes, A Metropolis-class sampler for targets with non-convex support, Convergence of Markov chain transition probabilities, The random heat equation in dimensions three and higher: the homogenization viewpoint, Stochastic approximation cut algorithm for inference in modularized Bayesian models, Nonzero-sum risk-sensitive average stochastic games: The case of unbounded costs, On structural properties of optimal average cost functions in Markov decision processes with Borel spaces and universally measurable policies, Markov chain simulation for multilevel Monte Carlo, On the mean field limit of the random batch method for interacting particle systems, Empirical process theory for locally stationary processes, Mixing and hitting times for Gibbs samplers and other non-Feller processes, On convergence of random walks on moduli space, Regenerative properties of the linear Hawkes process with unbounded memory, Revisiting the Gelman-Rubin diagnostic, Criteria for geometric and algebraic transience for discrete-time Markov chains, Slowly varying asymptotics for signed stochastic difference equations, Adaptive invariant density estimation for continuous-time mixing Markov processes under sup-norm risk, Regularity of models associated with Markov jump processes, Generating diffusions with fractional Brownian motion, Invariant measures for multidimensional fractional stochastic volatility models, Limit theorems for branching processes with immigration in a random environment, Fundamental design principles for reinforcement learning algorithms, State space collapse for multi-class queueing networks under SBP service policies, Economic MPC of Markov decision processes: dissipativity in undiscounted infinite-horizon optimal control, Convergence rates in uniform ergodicity by hitting times and $L^2$-exponential convergence rates, On the Hill relation and the mean reaction time for metastable processes, How does noise induce order?, Mixing time guarantees for unadjusted Hamiltonian Monte Carlo, Variational formulas for asymptotic variance of general discrete-time Markov chains, A new approach to Pólya urn schemes and its infinite color generalization, Wasserstein-based methods for convergence complexity analysis of MCMC with applications, Technical Note—Approximating Systems Fed by Poisson Processes with Rapidly Changing Arrival Rates, Some Limit Properties of Markov Chains Induced by Recursive Stochastic Algorithms, Damping of Kinetic Transport Equation with Diffuse Boundary Condition, A Proximal Markov Chain Monte Carlo Method for Bayesian Inference in Imaging Inverse Problems: When Langevin Meets Moreau, Rare Event Simulation Using Reversible Shaking Transformations, Diffusivity in multiple scattering systems, SUBGEOMETRICALLY ERGODIC AUTOREGRESSIONS, Statistics of transitions for Markov chains with periodic forcing, The rescaled Pólya urn: local reinforcement and chi-squared goodness-of-fit test, Long-Time Behavior of a Hawkes Process--Based Limit Order Book, Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learning, An Exact Auxiliary Variable Gibbs Sampler for a Class of Diffusions, Efficient Parameter Sampling for Markov Jump Processes, Unnamed Item, Unnamed Item, On Foster–Lyapunov criteria for exponential ergodicity of regime-switching jump diffusion processes with countable regimes, Stochastic perturbations of convex billiards, Ergodicity, Decisions, and Partial Information, Simple and Optimal Methods for Stochastic Variational Inequalities, II: Markovian Noise and Policy Evaluation in Reinforcement Learning, On uniqueness of invariant measures for random walks on, Queueing Network Controls via Deep Reinforcement Learning, On Linear Programming for Constrained and Unconstrained Average-Cost Markov Decision Processes with Countable Action Spaces and Strictly Unbounded Costs, Geometric ergodicity of the multivariate COGARCH(1,1) process, The asymptotic equipartition property of Markov chains in single infinite Markovian environment on countable state space, Moments and ergodicity of the jump-diffusion CIR process, Exponential moments of simultaneous hitting time for non-atomic Markov chains, Unnamed Item, Dynamics of the stochastic Lorenz chaotic system with long memory effects, Unnamed Item, Large time behaviors of upwind schemes and $B$-schemes for Fokker-Planck equations on $\mathbb {R}$ by jump processes, Ordinary Differential Equation Methods for Markov Decision Processes and Application to Kullback--Leibler Control Cost, Ergodicity and Diffusivity of Markovian Order Book Models: A General Framework, Diffusion Map-based Algorithm for Gain Function Approximation in the Feedback Particle Filter, Random products of maps synchronizing on average, Random iteration with place dependent probabilities, Inert drift system in a viscous fluid: Steady state asymptotics and exponential ergodicity, Unnamed Item, Stability Conditions for Queueing Systems with Regenerative Flow of Interruptions, Average Cost Optimality Inequality for Markov Decision Processes with Borel Spaces and Universally Measurable Policies, Ergodic Approximation to Chemical Reaction System with Delay, Deterministic and Stochastic Wireless Network Games: Equilibrium, Dynamics, and Price of Anarchy, Conditional law of large numbers and entropy of Markov processes, Correction to: Random Coefficient Autoregressive Processes: a Markov Chain Analysis of Stationarity and Finiteness of Moments by Paul D. Feigin and Richard L. Tweedie J. Time Series Anal., Vol. 6, No. 1 (1985), A note on stochastic dominance, uniform integrability and lattice properties, K-th Record Values and Their Basic Properties, Multiagent model and mean field theory of complex auction dynamics, Strong convergence of infinite color balanced urns under uniform ergodicity, On geometric and algebraic transience for block-structured Markov chains, Quantum algorithm and circuit design solving the Poisson equation, Quantitative Harris-type theorems for diffusions and McKean–Vlasov processes, A weak perturbation theory for approximations of invariant measures in M/G/1 model, Pathwise accuracy and ergodicity of metropolized integrators for SDEs, On Generalized Bellman Equations and Temporal-Difference Learning, Subgeometric ergodicity and β-mixing, Effective mixing and counting in Bruhat–Tits trees, Quantitative Estimates for the Long-Time Behavior of an Ergodic Variant of the Telegraph Process, Spread out random walks on homogeneous spaces, A LIMIT THEOREM FOR OCCUPATION MEASURES OF LÉVY PROCESSES IN COMPACT GROUPS, Monotone bivariate Markov kernels with specified marginals, Ergodicity of Markov Processes via Nonstandard Analysis, How Deep Are Deep Gaussian Processes?, Optimal Online Selection of an Alternating Subsequence: A Central Limit Theorem, Estimation in Discretely Observed Diffusions Killed at a Threshold, Change Detection in INAR(p) Processes Against Various Alternative Hypotheses, Ergodicity of Markov chain Monte Carlo with reversible proposal, On the anisotropic stable JCIR process, Efficient Bayesian Computation by Proximal Markov Chain Monte Carlo: When Langevin Meets Moreau, An online change detection test for parametric discrete-time stochastic processes, Exact simulation of the extrema of stable processes, Asymptotic variance for random walk Metropolis chains in high dimensions: logarithmic growth via the Poisson equation, Nonzero-Sum Expected Average Discrete-Time Stochastic Games: The Case of Uncountable Spaces, Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach, Replica-Mean-Field Limits for Intensity-Based Neural Networks, Weak Poincaré inequalities for convolution probabilities measures, Uniform convergence of conditional distributions for absorbed one-dimensional diffusions, Error bounds for augmented truncation approximations of Markov chains via the perturbation method, Integral estimation based on Markovian design, Ladder epochs and ladder chain of a Markov random walk with discrete driving chain, A Sensitivity‐Based Construction Approach to Variance Minimization of Markov Decision Processes, A Markov Model of a Limit Order Book: Thresholds, Recurrence, and Trading Strategies, Nonzero-Sum Risk-Sensitive Stochastic Games on a Countable State Space, Simulated Stochastic Approximation Annealing for Global Optimization With a Square-Root Cooling Schedule, Convergence to Periodic Probability Solutions in Fokker--Planck Equations, Unnamed Item, Ergodic impulse control with constraint: locally compact case, COUNT AND DURATION TIME SERIES WITH EQUAL CONDITIONAL STOCHASTIC AND MEAN ORDERS, Multilevel Markov Chain Monte Carlo for Bayesian Inversion of Parabolic Partial Differential Equations under Gaussian Prior, The Missing Piece Syndrome in Peer-to-Peer Communication, Stability of a Stochastic Model for Demand-Response, A probabilistic view on the long-time behaviour of growth-fragmentation semigroups with bounded fragmentation rates, Analysis of a multilevel Markov chain Monte Carlo finite element method for Bayesian inversion of log-normal diffusions, Unnamed Item, Unnamed Item, On some basic features of strictly stationary, reversible Markov chains, Unnamed Item, Unnamed Item, Discrete-time constrained stochastic games with the expected average payoff criteria, Forecasting with Multivariate Threshold Autoregressive Models, A Gaussian Mixture Autoregressive Model for Univariate Time Series, Generalized autoregressive moving average models with GARCH errors, ABC shadow algorithm: a tool for statistical analysis of spatial patterns, Regenerative Markov Chain Monte Carlo for Any Distribution, Computation of Gaussian orthant probabilities in high dimension, Perturbation analysis for continuous-time Markov chains, A survey of average contractive iterated function systems, Persistence for stochastic difference equations: a mini-review, Non-equilibrium steady states for chains of four rotors, Quantitative contraction rates for Markov chains on general state spaces, Computational Identification of Irreducible State-Spaces for Stochastic Reaction Networks, Mutation and selection in bacteria: modelling and calibration, Exponential convergence to quasi-stationary distribution and $Q$-process, BOUNDING TAIL PROBABILITIES IN DYNAMIC ECONOMIC MODELS, Rate of escape and central limit theorem for the supercritical Lamperti problem, Error Bounds for Augmented Truncations of Discrete-Time Block-Monotone Markov Chains under Subgeometric Drift Conditions, Data-Driven Reduction for a Class of Multiscale Fast-Slow Stochastic Dynamical Systems, Random Symmetrizations of Convex Bodies, Stationarity and Ergodicity for an Affine Two-Factor Model, Diffusivity of a random walk on random walks, Generalized Look-Ahead Methods for Computing Stationary Densities, Parameter and dimension dependence of convergence rates to stationarity for reflecting Brownian motions, Geometric ergodicity of the bouncy particle sampler, Stochastic equation and exponential ergodicity in Wasserstein distances for affine processes, Nonlinear branching processes with immigration, A note on the Birkhoff ergodic theorem, Estimating accuracy of the MCMC variance estimator: asymptotic normality for batch means estimators, Quantitative spectral gaps for hypoelliptic stochastic differential equations with small noise, Periodic autoregressive stochastic volatility, Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors, Another set of verifiable conditions for average Markov decision processes with Borel spaces, Convergence of partial sum processes to stable processes with application for aggregation of branching processes, Invariant measure for quantum trajectories, Subexponential upper and lower bounds in Wasserstein distance for Markov processes, Uniform Ergodicity of the Particle Gibbs Sampler, Persistence of sums of correlated increments and clustering in cellular automata, Berry-Esseen estimates for regenerative processes under weak moment assumptions, Orlicz Integrability of Additive Functionals of Harris Ergodic Markov Chains, Ergodicity of Lévy-Type Processes, Adaptive confidence bands for Markov chains and diffusions: Estimating the invariant measure and the drift, Infinitely ramified point measures and branching Lévy processes, The method of stochastic characteristics for linear second-order hypoelliptic equations, Learning from non-irreducible Markov chains, Limit theory for the largest eigenvalues of sample covariance matrices with heavy-tails, Simplicial gauge theory on spacetime, Approximation of the invariant measure with an Euler scheme for stochastic PDEs driven by space-time white noise, Asymptotic Expansions for Stationary Distributions of Perturbed Semi-Markov Processes, Cell speed is independent of force in a mathematical model of amoeboidal cell motion with random switching terms, Stochastic optimal growth with risky labor supply, Ramsey’s Discrete-Time Growth Model: A Markov Decision Approach with Stochastic Labor, Subgeometric rates of convergence of Markov processes in the Wasserstein metric, A central limit theorem for adaptive and interacting Markov chains, Conditions for convergence of random coefficient $\mathrm{AR}(1)$ processes and perpetuities in higher dimensions, A note on iterated function systems with discontinuous probabilities, Geometric ergodicity for Bayesian shrinkage models, Partial match queries in two-dimensional quadtrees: a probabilistic approach, Central limit theorems for stochastic approximation with controlled Markov chain dynamics, Hidden Markov model for parameter estimation of a random walk in a Markov environment, Long-time behavior for a class of Feller processes, Optimal Kullback–Leibler approximation of Markov chains via nuclear norm regularisation, Moment Closure and Finite-Time Blowup for Piecewise Deterministic Markov Processes, On the stability of sequential Monte Carlo methods in high dimensions, Persistence of stability for equilibria of map iterations in Banach spaces under small random perturbations, Rationally Inattentive Control of Markov Processes, A glimpse of the conformal structure of random planar maps, On the Markov-switching bilinear processes: stationarity, higher-order moments and β-mixing, Fixed-Delay Events in Generalized Semi-Markov Processes Revisited, A Geometric Drift Inequality for a Reflected Fractional Brownian Motion Process on the Positive Orthant, Persistence and extinction for stochastic ecological models with internal and external variables, Local stationarity and time-inhomogeneous Markov chains, Convergence complexity analysis of Albert and Chib's algorithm for Bayesian probit regression, Convergence to equilibrium in Fokker-Planck equations, Regenerative block empirical likelihood for Markov chains, Unnamed Item, Commercial and residential mortgage defaults: spatial dependence with frailty, A Becker-Tomes model with investment risk, Explicit Rates of Exponential Convergence for Reflected Jump-Diffusions on the Half-Line, Divergent Perpetuities Modulated by Regime Switches, Rademacher complexity for Markov chains: applications to kernel smoothing and Metropolis-Hastings, Higher order Langevin Monte Carlo algorithm, On the rate of convergence to equilibrium for two-sided reflected Brownian motion and for the Ornstein-Uhlenbeck process, On a Feynman-Kac approach to growth-fragmentation semigroups and their asymptotic behaviors, Existence of periodic probability solutions to Fokker-Planck equations with applications, Decay rates for stabilization of linear continuous-time systems with random switching, Stochastic proximal-gradient algorithms for penalized mixed models, Informed sub-sampling MCMC: approximate Bayesian inference for large datasets, Double asymptotic for random walks on hypercubes, Ergodicity of the zigzag process, Stochastic neural field model: multiple firing events and correlations, Selection of Vine Copulas, A MATHEMATICAL APPROACH TO ORDER BOOK MODELING, A class of Markov chains with no spectral gap, Parameter maximum likelihood estimation problem for time periodic modulated drift Ornstein Uhlenbeck processes, Linear controller design for chance constrained systems, A multiscale analysis of diffusions on rapidly varying surfaces, An information guided framework for simulated annealing, Heavy tailed time series with extremal independence, Asymptotic exponential arbitrage and utility-based asymptotic arbitrage in Markovian models of financial markets, Langevin dynamics with space-time periodic nonequilibrium forcing, Quantifying gene expression variability arising from randomness in cell division times, Bayesian semiparametric Wiener system identification, Probabilistic approach to Perron root, the group inverse, and applications, Weighted batch means estimators in Markov chain Monte Carlo, A new bivariate integer-valued GARCH model allowing for negative cross-correlation, Which ergodic averages have finite asymptotic variance?, Wealth and price distribution by diffusive approximation in a repeated prediction market, The strong Feller property for singular stochastic PDEs, Estimates on the amplitude of the first Dirichlet eigenvector in discrete frameworks, A service system with on-demand agent invitations, Constrictive Markov operators induced by Markov processes, Dynamic scheduling with reconfiguration delays, Discrete one-dimensional coverage process on a renewal process, Exponential convergence rates of Markov chains under a weaken minorization condition, On the polynomial convergence rate to nonequilibrium steady states, Bootstrap uniform central limit theorems for Harris recurrent Markov chains, Convergence and efficiency of adaptive importance sampling techniques with partial biasing, The Monte Carlo computation error of transition probabilities, Ergodicity and loss of capacity for a random family of concave maps, An empirical Bayes approach to identification of modules in dynamic networks, Robust adaptive sliding mode control for nonlinear uncertain neutral Markovian jump systems, Random walks on binary strings applied to the somatic hypermutation of B-cells, Improving the convergence of reversible samplers, Stability of noisy Metropolis-Hastings, Analysis of an interacting particle method for rare event estimation, Slow recurrent regimes for a class of one-dimensional stochastic growth models, Rigorous results for the Stigler-Luckock model for the evolution of an order book, Clustering of Markov chain exceedances, Nonparametric estimation of the jump rate for non-homogeneous marked renewal processes, Existence of nonequilibrium steady state for a simple model of heat conduction, Estimation in threshold autoregressive models with correlated innovations, Multiple scattering in random mechanical systems and diffusion approximation, Tandem queueing networks with neighbor blocking and back-offs, A performance analysis of channel fragmentation in dynamic spectrum access systems, Stochastic alternating projections, Structural changes in autoregressive models for binary time series, Generalized ARMA models with martingale difference errors, Geometric ergodicity and the spectral gap of non-reversible Markov chains, Ergodicity and asymptotic stability of Feller semigroups on Polish metric spaces, A computational model of outguessing in two-player non-cooperative games, Fast computation of stationary joint probability distribution of sparse Markov chains, Random iterations of homeomorphisms on the circle, On nonlinear TAR processes and threshold estimation, On the existence and uniqueness of stationary equilibrium in Bewley economies with production, Stochastic optimal growth model with risk sensitive preferences, Stochastic stability of monotone economies in regenerative environments, Phantom distribution functions for some stationary sequences, Model selection in reinforcement learning, Stability with file arrivals and departures in multichannel cellular wireless networks, Monte Carlo methods for light propagation in biological tissues, Numerical simulation of polynomial-speed convergence phenomenon, Linear variance bounds for particle approximations of time-homogeneous Feynman-Kac formulae, A new approach to Boltzmann's ergodic hypothesis, A probabilistic approach to spectral analysis of growth-fragmentation equations, Strong and weak orders in averaging for SPDEs, Stochastic analysis of the motion of DNA nanomechanical bipeds, Asymptotic bias of stochastic gradient search, Elo ratings and the sports model: a neglected topic in applied probability?, On nonlinear Markov chain Monte Carlo, Perturbation theory for Markov chains via Wasserstein distance, Convergence of adaptive and interacting Markov chain Monte Carlo algorithms, Asymptotic fitness distribution in the Bak-Sneppen model of biological evolution with four species, Ergodicity and stability of the conditional distributions of nondegenerate Markov chains, On the Viterbi process with continuous state space, Hypoellipticity and ergodicity of the Wonham filter as a diffusion process, Analysis and optimization of resource control in high-speed railway wireless networks, Ancestral lineages and limit theorems for branching Markov chains in varying environment, Probabilistic model validation for uncertain nonlinear systems, Validity of heavy-traffic steady-state approximations in many-server queues with abandonment, Rank-driven Markov processes, Markov chain Monte Carlo estimation of quantiles, Ergodicity of a Lévy-driven SDE arising from multiclass many-server queues, How well do reduced models capture the dynamics in models of interacting neurons?, Random switching between vector fields having a common zero, Asymptotic properties of the maximum likelihood estimator in regime switching econometric models, Convergence rates for a class of estimators based on Stein's method, Parameter estimation for reflected Ornstein-Uhlenbeck processes with discrete observations, A continuous-time model of centrally coordinated motion with random switching, On the convergence of formally diverging neural net-based classifiers, On the effectiveness of Monte Carlo for initial uncertainty forecasting in nonlinear dynamical systems, Respondent-driven sampling and sparse graph convergence, Finite approximation of the first passage models for discrete-time Markov decision processes with varying discount factors, Entropic fluctuations in thermally driven harmonic networks, Quasiperiodicity and phase locking in stochastic circle maps: a spectral approach, Planning for the long run: programming with patient, Pareto responsive preferences, Polynomial bounds in the Ergodic theorem for one-dimensional diffusions and integrability of hitting times, Illustrated review of convergence conditions of the value iteration algorithm and the rolling horizon procedure for average-cost MDPs, Gaussian mixture vector autoregression, Exploring the qualitative behavior of uncertain dynamical systems: a computational approach, $V$-uniform ergodicity for state-dependent single class queueing networks, Variable transformation to obtain geometric ergodicity in the random-walk Metropolis algorithm, Time series models with infinite-order partial copula dependence, A note on bias and mean squared error in steady-state quantile estimation, Integral-type functionals of first hitting times for continuous-time Markov chains, Fluctuation theory for Markov random walks, Asymptotic behavior of random coefficient INAR model under random environment defined by difference equation, Infinite horizon stopping problems with (nearly) total reward criteria, Handy sufficient conditions for the convergence of the maximum likelihood estimator in observation-driven models, Sub-exponential convergence to equilibrium for Gaussian driven stochastic differential equations with semi-contractive drift, Stability of overshoots of zero mean random walks, Convergence of moments in a Markov-chain central limit theorem, Random logistic maps and Lyapunov exponents, Review on computational methods for Lyapunov functions