Mean-payoff optimization in continuous-time Markov chains with parametric alarms

DOI10.1145/3310225zbMath1544.90204MaRDI QIDQ6600073

Clemens Dubslaff, Ľuboš Korenčiak, Christel Baier, Antonín Kučera, Vojtěch Řehák

Publication date: 8 September 2024

Published in: ACM Transactions on Modeling and Computer Simulation (Search for Journal in Brave)

zbMATH Keywords

semi-Markov decision processesMarkov regenerative processesparameter synthesisgeneralized semi-Markov processesnon-Markovian distributions

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Applications of continuous-time Markov processes on discrete state spaces (60J28)

Cites Work

• Unnamed Item
• Unnamed Item
• Finding optimal memoryless policies of POMDPs under the expected average reward criterion
• Synthesis and infeasibility analysis for stochastic models of biochemical systems using statistical model checking and abstraction refinement
• Fixed-Delay Events in Generalized Semi-Markov Processes Revisited
• Regenerative Markov Chain Monte Carlo for Any Distribution
• Reachability in Succinct and Parametric One-Counter Automata
• Parameter Synthesis for Probabilistic Timed Automata Using Stochastic Game Abstractions
• Parametric Model-Checking of Time Petri Nets with Stopwatches Using the State-Class Graph
• A performance gradient perspective on gradient‐based policy iteration and a modified value iteration
• Two-Point Step Size Gradient Methods
• Markov Chains
• An improved numerical algorithm for calculating steady-state solutions of deterministic and stochastic Petri net models
• Stochastic Petri Nets
• Mean-Payoff Optimization in Continuous-Time Markov Chains with Parametric Alarms
• Parametric real-time reasoning

This page was built for publication: Mean-payoff optimization in continuous-time Markov chains with parametric alarms