상세정보
학술대회
Partial Materialization for Data Integration in SQL-on-Hadoop Engines
- 발행일
- 201609
- 출처
- International Conference on IT Convergence and Security (ICITCS) 2016, pp.1-2
- 협약과제
- 16ZS1400, 듀얼모드 배치.쿼리 분석을 제공하는 빅데이터 플랫폼 핵심기술 개발, 원종호
- 초록
- SQL-on-Hadoop engines are considered as useful data integration tools for large-scale data. However, they may incur redundant network overhead by redistributing the intermediate results multiple times in the cases where a number of attributes are included in the query result. We propose an optimization method using partial materialization which avoids repetitively redistributing trivial attributes.
- KSP 제안 키워드
- Large-scale data, Network overhead, SQL-on-hadoop, data integration, optimization methods