Markov automata with multiple objectives

DOI10.1007/978-3-319-63387-9_7zbMath1494.68146arXiv1704.06648OpenAlexW2609905251MaRDI QIDQ2151241

Sebastian Junges, Tim Quatmann, Joost-Pieter Katoen

Publication date: 1 July 2022

Published in: Formal Methods in System Design (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1704.06648

zbMATH Keywords

Markov decision processdecision supportmulti-objectivecontinuous-time Markov decision processesprobabilistic model checkingMarkov automataapproximate Pareto curveachievement pointsmulti-objective model checking

Mathematics Subject Classification ID

Multi-objective and goal programming (90C29) Formal languages and automata (68Q45) Markov and semi-Markov decision processes (90C40) Specification and verification (program logics, model checking, etc.) (68Q60) Probability in computer science (algorithm analysis, random structures, phase transitions, etc.) (68Q87)

Related Items (4)

Simple Strategies in Multi-Objective MDPs ⋮ Markov automata with multiple objectives ⋮ Multi-cost bounded tradeoff analysis in MDP ⋮ Multi-objective optimization of long-run average and total rewards

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Trading performance for stability in Markov decision processes
• Verification of multiprocess probabilistic protocols
• On the semantics of Markov automata
• Markov automata with multiple objectives
• Ensuring the reliability of your model checker: interval iteration for Markov decision processes
• Value iteration for long-run average reward in Markov decision processes
• Multi-cost bounded tradeoff analysis in MDP
• On Stochastic Games with Multiple Objectives
• A Survey of Multi-Objective Sequential Decision-Making
• Efficient Modelling and Generation of Markov Automata
• Analysis of Timed and Long-Run Objectives for Markov Automata
• Meet Your Expectations With Guarantees: Beyond Worst-Case Synthesis in Quantitative Games
• Quantitative Multi-objective Verification for Probabilistic Systems
• Reachability in MDPs: Refining Convergence of Value Iteration
• On Time with Minimal Expected Cost!
• Modelling and Analysis of Markov Reward Automata
• Optimal Continuous Time Markov Decisions
• Delayed Nondeterminism in Continuous-Time Markov Decision Processes
• Multi-Objective Model Checking of Markov Decision Processes
• Towards Performance Prediction of Compositional Models in Industrial GALS Designs
• Sequencing Tasks with Exponential Service Times to Minimize the Expected Flow Time or Makespan
• Nondeterministic Polling Systems
• Pareto Curves for Probabilistic Model Checking
• Simple Strategies in Multi-Objective MDPs
• Stochastic Shortest Paths and Weight-Bounded Properties in Markov Decision Processes
• Variations on the Stochastic Shortest Path Problem
• Strategy Synthesis for Stochastic Games with Multiple Long-Run Objectives
• A Semantics for Every GSPN
• Cost vs. Time in Stochastic Games and Markov Automata
• Markov Decision Processes with Multiple Long-run Average Objectives
• Continuous-time Markov decisions based on partial exploration

This page was built for publication: Markov automata with multiple objectives