Accelerating external sorting via on-the-fly data merge in active SSDs
Young-Sik Lee, Luis Cavazos Quero, Youngjae Lee, Jin‐Soo Kim, Seungryoul Maeng · USENIX conference on Hot topics in storage and file systems · 2014
The concept of active SSDs (solid state drives) has been introduced in order to cope with the demands required to process the ever-increasing volumes of data. In active SSDs, some of the data-processing tasks are offloaded to SSDs, freeing host system resources and improving overall performance of data analysis. In this paper, we propose a novel active SSD architecture focused on improving the external sorting algorithm that is used extensively in data-intensive computing. By performing merge operations on-the-fly in active SSDs, our method can remove the extra data transfer and enhance the lifetime of SSDs. Our evaluation results on a real SSD platform indicate that the proposed scheme out-performs the traditional external sorting by up to 39%.