BROWSE
Detail
Journal Article
BigCrawler: 엣지 서버 컴퓨팅·스토리지 모듈의 동적 구성을 통한 효율적인 빅데이터 처리 시스템 구현 및 성능 분석
Cited - time in 
Share 
Share
- Issue Date
- 2021-12
- Citation
- 대한임베디드공학회논문지, v.16, no.6, pp.259-266
- ISSN
- 1975-5066
- Publisher
- 대한임베디드공학회
- Language
- Korean
- Type
- Journal Article
- Abstract
- Edge Computing enables real-time big data processing by performing computing close to the physical location of the user or data source. However, in an edge computing environment, various situations that affect big data processing performance may occur depending on temporary service requirements or changes of physical resources in the field. In this paper, we proposed a BigCrawler system that dynamically configures the computing module and storage module according to the big data collection status and computing resource usage status in the edge computing environment. And the feature of big data processing workload according to the arrangement of computing module and storage module were analyzed.
- KSP Keywords
- Big Data Processing, Computing environment, Computing resources, Data Collection, Physical location, Resource usage, Service requirements, data sources, edge computing, processing performance, real-Time big data