상세정보
학술대회
The Study on Large Scale Image Processing Architecture Based on Hadoop2.0 Clusters
- 발행일
- 201509
- 출처
- International Conference on Consumer Electronics (ICCE) 2015 : Berlin, pp.474-475
- 초록
- This paper describes the DeepView platform which is a pilot system to classify large scaled images collected from a VMS server based on Hadoop 2.0 clusters. Multiple DeepView Classifier tasks analyze images simultaneously to detect objects in the images. Classifier task is implemented as a direct YARN task instead of MapReduce task to avoid intensive disk I/O and limited input format. Moreover, the small data access problem of Hadoop can be avoided because Application Master controls YARN tasks to access only local blocks of image files before image classification starts.
- KSP 제안 키워드
- Data Access, Disk I/O, Image classification, Image files, Image processing, Large scale image, Processing architecture, Small data, pilot system