Facility Information Management on HBase: Large-Scale Storage for Time-Series Data
Hideya Ochiai, Hiroyuki Ikegami, Yuuichi Teranishi, Hiroshi Esaki · 2014
A very large number of sensors on facilities such as HVAC, light control systems and electric power meters, periodically submit their status information to Cloud platforms these days. As the amount of data can easily get petabyte scale, we must consider the use of distributed application layer storage for managing such facility information, which is often formatted on time-series data. This paper describes FIAP Storage Peta, petabyte scale storage for facility information access protocol (FIAP), proposing the architecture and the scheme of such data management on HBase. In this work, we have identified three requirements to the design of HBase row keys for implementing this storage using HBase. Though, we have not finished petabyte scale experiments, our preliminary evaluation results have shown good performance for managing large scale facility information. It has achieved scalable data retrieval on the data of 10 million sensors with properly balancing loads on distributed data storages.