Obtaining a Continuous Time Markov Decision Process from Statecharts
Marcelino Silva, Ádamo Lima de Santana, Carlos Renato Lisboa Francês, Nandamudi Lankalapalli Vijaykumar, Solon Carvalho · 2009
This paper proposes a strategy to associate Statecharts with a Markov Decision Process for performance evaluation. Statecharts are adapted to represent the possible decision choices and the costs incurred from decisions. Markov Decision Process is used to evaluate the long term effects of decisions. This strategy can aid users without a good knowledge of the performance evaluation process, and may participate in a more effective way in the modeling phase, providing information to make a more realistic model.