A MDP-Based Adaptive Decision-Making Method:Dealing with Run-Time Service Uncertainties
Wang Zhong · Chinese Journal of Computers · 2013
The execution of a service system is faced with a variety of uncertainties which lead to the expected values cannot be fully implemented and delivered.There are several strategies to handle these uncertainties but different ones will result in different consequences,e.g.,the possibility of a final successful execution,the time delay and cost overflow.It is necessary to pursue the optimized one based on the dynamic execution of services,so that the loss of uncertainties and the cost paid to the selected strategy are both minimized.Service uncertainties and the corresponding decision strategies are classified,then based on the states of service execution,Uncertainty Triggering Graph(UTG) is proposed to describe the triggering relations between uncertain states and decision strategies.Next,a Markov Decision Process(MDP) based algorithm is presented to help select the global optimized strategy.Simulation experiments validate the effectiveness of our model and method,and some key factors that impact the decision effects are briefly discussed.