ETRI-Knowledge Sharing Plaform



논문 검색
구분 SCI
연도 ~ 키워드


학술지 Fixed Homography-Based Real-Time SW/HW Image Stitching Engine for Motor Vehicles
Cited 4 time in scopus Download 4 time Share share facebook twitter linkedin kakaostory
석정희, 여준기, 윤상훈, 노태문
ETRI Journal, v.37 no.6, pp.1143-1153
한국전자통신연구원 (ETRI)
12MB2500, 다중카메라 기반 고속 영상인식 SoC 플랫폼, 노태문
In this paper, we propose an efficient architecture for a real-time image stitching engine for vision SoCs found in motor vehicles. To enlarge the obstacle-detection distance and area for safety, we adopt panoramic images from multiple telegraphic cameras. We propose a stitching method based on a fixed homography that is educed from the initial frame of a video sequence and is used to warp all input images without regeneration. Because the fixed homography is generated only once at the initial state, we can calculate it using SW to reduce HW costs. The proposed warping HW engine is based on a linear transform of the pixel positions of warped images and can reduce the computational complexity by 90% or more as compared to a conventional method. A dual-core SW/HW image stitching engine is applied to stitching input frames in parallel to improve the performance by 70% or more as compared to a single-core engine operation. In addition, a dual-core structure is used to detect a failure in state machines using rock-step logic to satisfy the ISO26262 standard. The dual-core SW/HW image stitching engine is fabricated in SoC with 254,968 gate counts using Global Foundry창?궗?꽓s 65 nm CMOS process. The single-core engine can make panoramic images from three YCbCr 4:2:0 formatted VGA images at 44 frames per second and frequency of 200 MHz without an LCD display.
KSP 제안 키워드
65nm CMOS, CMOS Process, Computational complexity, Conventional methods, Core structure, Detection distance, Dual-core, Frames per second(FPS), Homography-based, Image Stitching, LCD display