Performance measurements for evaluating static and dynamic multiple human detection and tracking systems in unstructured environments
Barry Bodt, Richard Camden, Harry A. Scott, Adam S. Jacoff, Tsai Hong Hong, Tommy Chang, Rick Norcross, Tony Downs, Ann Virts · 2009
The Army Research Laboratory (ARL) Robotics Collaborative Technology Alliance (CTA) conducted an assessment and evaluation of multiple algorithms for real-time detection of pedestrians in Laser Detection and Ranging (LADAR) and video sensor data taken from a moving platform. The algorithms were developed by Robotics CTA members and then assessed in field experiments jointly conducted by the National Institute of Standards and Technology (NIST) and ARL. A robust, accurate and independent pedestrian tracking system was developed to provide ground truth. The ground truth was used to evaluate the CTA member algorithms for uncertainty and error in their results. A real-time display system was used to provide early detection of errors in data collection.