상세정보
학술대회
Disparity Refinement with Guided Filtering of Soft 3D Cost Function in Multi-view Stereo System
- 발행일
- 201912
- 출처
- Image and Vision Computing New Zealand (IVCNZ) 2019, pp.1-5
- 협약과제
- 19HR2500, [통합과제] 초실감 테라미디어를 위한 AV부호화 및 LF미디어 원천기술 개발, 최진수
- 초록
- In multi-view stereo systems, occlusions occurs in various viewing directions. In occlusion image areas, disparity estimation is generally inaccurate because the matching cost computation is incorrect. Therefore, correction or refinement of disparity values in the occlusion area is an important issue in the stereo vision study. The soft 3D reconstruction method, recently introduced by Google, refines inaccurate disparity values in the occlusion areas by using the probability of visibility (PV) in every image pixels. The probability of visibility is computed using initial disparity maps of a multi-view stereo system. Then, the probability is refined using a guide filter. The guide of the filter is the reference color image. However, the color image can include noise due to the viewing direction of the reference camera, light reflection, etc. Therefore, the probability is affected by the image noise. In this paper, we propose a disparity refinement method to enhance the performance of the original soft 3D reconstruction by adopting bilaterally filtered color images as the guide image. The bilateral filter preserves image edge while color noise are minimized by Gaussian smoothing. The filtered color image is used as the guide filter when computing a 3D probability volume of visibility in the soft 3D reconstruction. In experiments, we reconstruct 3D point cloud with the refined disparity maps.
- KSP 제안 키워드
- 3D Reconstruction, 3D point cloud, Bilateral Filter, Color images, Color noise, Cost Function, Disparity Map, Disparity refinement, Gaussian smoothing, Matching cost computation, Multi-view stereo