BROWSE
Detail
Conference Paper
Partial Materialization for Data Integration in SQL-on-Hadoop Engines
Cited 1 time in 
Share 
Share
- Authors
- Taewhi Lee, Moonyoung Chung, Sung-Soo Kim, Hyewon Song, Jongho Won
- Issue Date
- 2016-09
- Citation
- International Conference on IT Convergence and Security (ICITCS) 2016, pp.1-2
- Language
- English
- Type
- Conference Paper
- Abstract
- SQL-on-Hadoop engines are considered as useful data integration tools for large-scale data. However, they may incur redundant network overhead by redistributing the intermediate results multiple times in the cases where a number of attributes are included in the query result. We propose an optimization method using partial materialization which avoids repetitively redistributing trivial attributes.
- KSP Keywords
- Large-scale Data, Network overhead, Optimization methods, SQL-on-hadoop, data integration