Monitoring progress with dynamic programming envelopes
Robert St. Amant, Y. Kuwata, Paul R. Cohen · 2002
Envelopes are a form of decision rule for monitoring plan execution. We describe one type, the DP (dynamic programming) envelope, that draws its decisions from a look-up table computed off-line by dynamic programming. Based on an abstract model of agent progress, DP envelopes let a developer approach execution monitoring as a problem that is independent of issues in agent design. We discuss the application of DP envelopes to a small transportation planning simulation, and discuss the issues that arise in an empirical analysis of the results.