Similarity-Based Shield Adaptation under Dynamic Environment
Prasanth Senthilvelan, Jialong Li, Kenji Tei · 2023
In this paper, we present an efficient design of a shield called Parameterized Shield which allows for easy modification of its requirement parameters in response to the changes in the environment instead of manually making many shields during the development time and changing the whole shield during runtime. We propose to generate one proper shield that has many requirement parameters where even when there is any complex situation, there is not any need for extra effort from engineers to develop additional requirements and prepare the shield but only the parameters need to be changed when there is a change in the environment which avoids choosing a whole new shield every time an environment change occurs during runtime. And similarity-based adaptation will be used to choose the right parameters for the shield according to the environment with the help of the MAPE-K loop framework and reinforcement learning and to give the appropriate policy for the agent to act according to that environment. We will demonstrate using a cleaning robot as an example.