A platform for massive heterogeneous astronomical data retrieval

Xu Liu, Jizhou Sun, Jian Kun Xiao, Ce Yu, Ao Yuan, Runtao Wang, Qing Zhao · 2011

The efficiency of data retrieval from massive heterogeneous astronomical catalogs, as well as integration of various astronomical data retrieval services, are both key problems in astronomical data retrieval. This paper introduces a platform for Massive Heterogeneous Astronomical Data Retrieval (MHADR) which has been applied to the data center of National Astronomical Observatory of China. It proposes an index mechanism based on cross-matching to retrieve massive heterogeneous astronomical data resources from multiple catalogs efficiently. And on the platform it integrates various data retrieval services using the structure of four modules. ConeSearch service is implemented as a sample service of the platform. And the experiment shows the cross-matching in the retrieval costs nearly 25s, which implies the high efficiency cross-matching.

Read the paper · More papers on PaperTik