Facilitating external sorting on SMR-based large-scale storage systems

doi:10.1016/j.future.2020.10.032

淡江大學機構典藏 > 工學院 > 電機工程學系暨研究所 > 期刊論文 > Item 987654321/121000

請使用永久網址來引用或連結此文件: https://tkuir.lib.tku.edu.tw/dspace/handle/987654321/121000

題名:	Facilitating external sorting on SMR-based large-scale storage systems
作者:	Chen, Chih-Hsuan;Chen, Shuo-Han;Liang, Yu-Pei;Chen, Tseng-Yi;Hsu, Tsan-sheng;Wei, Hsin-Wen;Shih, Wei-Kuan
關鍵詞:	SMR;External sorting;In-storage processing;Data-intensive computing
日期:	2021-03
上傳時間:	2021-08-24 12:11:03 (UTC+8)
出版者:	ELSEVIER
摘要:	In the big data era, retaining the capability to process and store the sheer amount of data has become a necessity for data-intensive computing. To meet the requirement of big data processing, the storage-centric computing concept of processing data within storage devices has gained its popularity over the years, because the latency and energy consumed by moving data between host systems and storage devices gradually exceed that of processing data. To process data for data-intensive computing, one of the fundamental data processing technique is external sorting, which is widely used in database management systems (DBMS) and Hadoop framework. On the other hand, to store the ever-increasing volumes of data, shingled magnetic recording (SMR) drives have been proposed to increase the areal density of conventional hard disk drives (HDDs) via overlapping adjacent tracks. The SMR drive is widely regarded as a promising technology for the big data application because SMR drives can boost the capacity of HDDs without significant technology changes. Nevertheless, the overlapped track layout of SMR drive imposes the sequential write constraint on incoming write traffic, thus worsening the efficiency of performing external sorting on SMR drives. Such an observation motivates us to propose an SMR-based External Merge Sort (SMR-EMS) strategy for SMR-based large-scale storage systems with the goals of alleviating the negative impacts of sequential write constraint and enhancing the performance of external sorting on SMR drives via utilizing the concept of storage-centric computing. Experiments were conducted to demonstrate the capability of the proposed strategy on improving the efficiency of external merge sorting on SMR drives.
關聯:	Future Gener. Comput. Syst.,116,p.333-348
DOI:	10.1016/j.future.2020.10.032
顯示於類別:	[電機工程學系暨研究所] 期刊論文

文件中的檔案:

檔案	描述	大小	格式	瀏覽次數
index.html		0Kb	HTML	222	檢視/開啟

在機構典藏中所有的資料項目都受到原著作權保護.

TAIR相關文章

資料載入中.....