Approximate solving-solution of interactive dynamic influence diagrams
Bo Li, Jian Luo, 庄进发, Huayi Yin · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · 2011
An approximate solution was presented based on the principle of behaviorally equivalent for interactive dynamic influence diagrams (I-DID). The amount of calculation was reduced by decomposing the I-DID model into more than one fragment and compressing the space of other agents' candidate models. First, the model of I-DID or DID at bottom level was split into sub-segments that include a number of time slices, then the solution of the first segment for the initial models was obtained, and the policy graph could be gotten by merging policy trees based on the principle of behaviorally equivalent. Continue to solve the next I-DID or DID, the output of the previous fragment was regarded as the input for the subsequent fragment, until the last fragment, and the whole policy graph was available, which identifying whether the model needed to be updated. Experiment results, which on the quality of solution and the magnitude of model space for multi-agent tiger problem, show the validity of the approximate method.