Grounding abstractions in predictive state representations
Brian K Tanner, Vadim Bulitko, Anna Koop, Cosmin Păduraru · 2007
This paper proposes a systematic approach of rep-resenting abstract features in terms of low-level, subjective state representations. We demonstrate that a mapping between the agent’s predictive state representation and abstract features can be derived automatically from high-level training data sup-plied by the designer. Our empirical evaluation demonstrates that an experience-oriented state rep-resentation built around a single-bit sensor can rep-resent useful abstract features such as “back against a wall”, “in a corner”, or “in a room”. As a result, the agent gains virtual sensors that could be used by its control policy.1 1