MARKOV DECISION PROCESS FOR ADAPTIVE CONTROL OF DISTRIBUTED BODY SENSOR NETWORKS
Shuping Liu, Anand V. Panangadan, Ashit Talukder, Cauligi S. Raghavendra · 2016
This chapter considers a mobile, continuous health monitoring body sensor network where the size and ergonomic constraints severely limit the availability of power to battery sources that can be recharged only every few days or weeks. It describes how to frame the coordinated sensing problem using the formalism of Markov decision processes (MDPs). The chapter introduces MDPs and the rationale for using this formalism. It also describes related work in energy conservation in sensor networks and MDPs. The chapter examines the mathematical models for representing the sensor network as an MDP and the associated model functions. It discusses the approach for communication between sensor nodes to execute the coordinated sampling policy. The chapter also discusses the solution to the communication and coordination problem. It presents the detailed simulation results for global policy computation and lifetime analysis of this sensor system for different operational parameters of the system.