원문정보
초록
영어
Data analyzing and processing are important tasks in cloud computing. In this field, the MapReduce framework has become a more and more popular tool to analyze large-scale data over large clusters. Compared with the parallel relational database, it has the advantages of excellent scalability and good fault tolerance. However, the performance of join operation using MapReduce is not as good as that of parallel relational database. Thus, how to optimize theta-join operations using MapReduce is an attractive point to which researchers have been paying attention. In this paper, a randomized algorithm named Strict-Even-Join(SEJ) is designed to solve the multi-way theta-joins in a single MapReduce job. Moreover, a dynamic programming algorithm is elaborated to optimize the multi-way theta-joins by calling the SEJ algorithm. The results of experiments show that our approach is feasible and effective.
목차
1 Introduction
2 Related Work
3 Designing and Implementation of Strict-Even-Join
3.1 Multi-way Theta-joins in a Single MapReduce Job
3.2 Data Partitioning
3.3 Algorithm
3.4 Analysis of Skew Data
4 Optimizing Multi-Way Theta-Joins using MapReduce
4.1 Generating Optimal Query Plan
4.2 Concurrent MapReduce Jobs
5 Cost Model of Multi-way Joins using MapReduce
5.1 Building Equi-Width Histogram using MapReduce
5.2 Cost Model of Theta-Joins using MapReduce
5.3 Cost Model of Equi-Joins using MapReduce
6 Experiments
6.1 Effect of SEJ
6.2 Effect of Query Optimization
7 Conclusion and Future Work
8 Acknowledgements
References