earticle

논문검색

A Case for Flash Memory SSD in Hadoop Applications

초록

영어

As the access speed gap between DRAM and storage devices such as hard disk drives is ever widening, the I/O module dominantly becomes the system bottleneck. Meanwhile, the map-reduce parallel programming model has been actively studied for the last few years. In this paper, we will show empirically show that flash memory based SSD(Solid State Drive) is very beneficial when used as local storage devices in IO-intensive map-reduce applications (e.g. sorting) using Hadoop open source platform. Specifically, we present that external sorting algorithm in Hadoop with SSD can outperform the algorithm run with hard disk by more than 3. In addition, we also demonstrate that the power consumption can be drastically reduced when SSDs are used.

목차

Abstract
 1. Introduction
 2. Hadoop Structure
 3. SSD (Solid State Disk)
 4. Performance Test
  4.1. Sort Benchmark
  4.2. Join Benchmark
  4.3. Optimizing Hadoop
  4.4. Other Benchmarks
  4.5. Electricity Consumption
 5. Conclusion
 Acknowledgements
 References

저자정보

  • Seok-Hoon Kang Dept of Computer Engineering, Sungkyunkwan University, Korea
  • Dong-Hyun Koo Dept of Computer Engineering, Sungkyunkwan University, Korea
  • Woon-Hak Kang Dept of Computer Engineering, Sungkyunkwan University, Korea
  • Sang-Won Lee Dept of Computer Engineering, Sungkyunkwan University, Korea

참고문헌

자료제공 : 네이버학술정보

    함께 이용한 논문

      ※ 원문제공기관과의 협약기간이 종료되어 열람이 제한될 수 있습니다.

      0개의 논문이 장바구니에 담겼습니다.