상세정보
학술지
BigCrawler: 엣지 서버 컴퓨팅·스토리지 모듈의 동적 구성을 통한 효율적인 빅데이터 처리 시스템 구현 및 성능 분석
- 발행일
- 202112
- 출처
- 대한임베디드공학회논문지, v.16 no.6, pp.259-266
- ISSN
- 1975-5066
- 출판사
- 대한임베디드공학회
- 협약과제
- 21HS5100, 엣지 서버 시스템 자원 관리 및 제어를 위한 경량 시스템 소프트웨어 기술 개발, 강성주
- 초록
- Edge Computing enables real-time big data processing by performing computing close to the physical location of the user or data source. However, in an edge computing environment, various situations that affect big data processing performance may occur depending on temporary service requirements or changes of physical resources in the field. In this paper, we proposed a BigCrawler system that dynamically configures the computing module and storage module according to the big data collection status and computing resource usage status in the edge computing environment. And the feature of big data processing workload according to the arrangement of computing module and storage module were analyzed.
- KSP 제안 키워드
- Big Data Processing, Computing environment, Computing resources, Data Collection, Physical location, Resource usage, Service requirements, data sources, edge computing, processing performance, real-Time big data