Scenario-Based Verification of Uncertain MDPs

DOI10.1007/978-3-030-45190-5_16OpenAlexW3023500921WikidataQ98206888 ScholiaQ98206888MaRDI QIDQ5039513

Murat Cubuktepe, Sebastian Junges, Nils Jansen, Ufuk Topcu, Joost-Pieter Katoen

Publication date: 13 October 2022

Published in: Tools and Algorithms for the Construction and Analysis of Systems (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1912.11223

zbMATH Keywords

verificationuncertaintyMarkov decision processesscenario optimisation

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Specification and verification (program logics, model checking, etc.) (68Q60) Probability in computer science (algorithm analysis, random structures, phase transitions, etc.) (68Q87)

Related Items (2)

Model checking finite-horizon Markov chains with probabilistic inference ⋮ Sampling-Based Verification of CTMCs with Uncertain Rates

Uses Software

• PRISM
• SCS
• Storm

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• What is decidable about partially observable Markov decision processes with \(\omega\)-regular objectives
• Conic optimization via operator splitting and homogeneous self-dual embedding
• A sampling-and-discarding approach to chance-constrained optimization: feasibility and Optimality
• A logic for reasoning about time and reliability
• Bounded-parameter Markov decision processes
• Uncertain convex programs: randomized solutions and confidence levels
• Parameter synthesis for Markov models: faster than ever
• Bayesian statistical parameter synthesis for linear temporal properties of stochastic models
• The complexity of reachability in parametric Markov decision processes
• Chance-Constrained Programming
• Polynomial-Time Verification of PCTL Properties of MDPs with Convex Uncertainties
• Improving Time Bounded Reachability Computations in Interactive Markov Chains
• Decision Problems for Interval Markov Chains
• Theory and Applications of Robust Optimization
• Sequential Convex Programming for the Efficient Verification of Parametric MDPs
• The Exact Feasibility of Randomized Solutions of Uncertain Convex Programs
• Fast randomized consensus using shared memory
• A General Scenario Theory for Nonconvex Optimization and Decision Making
• Robust Markov Decision Processes
• Sampling Based Approaches for Minimizing Regret in Uncertain Markov Decision Processes (MDPs)
• The Scenario Approach to Robust Control Design
• Programming Languages and Systems
• Robust Control of Markov Decision Processes with Uncertain Transition Matrices
• Theoretical Aspects of Computing - ICTAC 2004
• Parameter-Independent Strategies for pMDPs via POMDPs

This page was built for publication: Scenario-Based Verification of Uncertain MDPs