Efficient sensitivity analysis for parametric robust Markov chains

DOI10.1007/978-3-031-37709-9_4zbMath1547.68406MaRDI QIDQ6535680

Ufuk Topcu, Sebastian Junges, Nils Jansen, Ahmadreza Marandi, Thom S. Badings

Publication date: 1 February 2024

Computational methods in Markov chains (60J22) Sensitivity, stability, parametric optimization (90C31) Specification and verification (program logics, model checking, etc.) (68Q60)

Cites Work

Unnamed Item
Unnamed Item
Unnamed Item
Unnamed Item
Unnamed Item
Unnamed Item
Unnamed Item
Unnamed Item
Smoothed model checking for uncertain continuous-time Markov chains
Parametric probabilistic transition systems for system design and analysis
Smoothed perturbation analysis derivative estimation for Markov chains
Data-efficient Bayesian verification of parametric Markov chains
Reachability in parametric interval Markov chains using constraints
Finding provably optimal Markov chains
Gradient-descent for randomized controllers under partial observability
Parametric Markov chains: PCTL complexity and fraction-free Gaussian elimination
Reachability in augmented interval Markov chains
The complexity of reachability in parametric Markov decision processes
Parameter Synthesis for Parametric Interval Markov Chains
Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties
Distributionally Robust Convex Optimization
Perturbation Analysis in Verification of Discrete-Time Markov Chains
Integral Boundary Points of Convex Polyhedra
Perturbation realization, potentials, and sensitivity analysis of Markov processes
Scenario-Based Verification of Uncertain MDPs
Integer Programming
From Bandits to Monte-Carlo Tree Search: The Optimistic Principle Applied to Optimization and Planning
Theoretical Aspects of Computing - ICTAC 2004
Model-based Reinforcement Learning: A Survey
Parameter Synthesis Algorithms for Parametric Interval Markov Chains
Tools and Algorithms for the Construction and Analysis of Systems
Convex Optimization for Parameter Synthesis in MDPs
Parameter synthesis in Markov models: a gentle survey
PAC statistical model checking for Markov decision processes and stochastic games
Abstraction-Refinement for Hierarchical Probabilistic Models
PAC Statistical Model Checking of Mean Payoff in Discrete- and Continuous-Time MDP

This page was built for publication: Efficient sensitivity analysis for parametric robust Markov chains