Dealing with the data deluge: file systems and storage technologies
David H. Denson · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2012
As defense and intelligence agencies seek to use the increasing amount of available data to make mission critical decisions on the battlefield, there is heavy emphasis on smart data and imagery collection: the capture, storage, and analysis necessary to drive real-time intelligence. This reality leads to an inevitable challenge-warfighters are increasingly swimming in sensors and drowning in data. With the millions, if not billions, of sensors in place that provide all-seeing reports of the combat environment, managing and tackling the overload is critical. This session highlights the capabilities of file systems and storage technologies that can interactively manage 100M+ files and 1PB+ single directory file systems.