ETRI-Knowledge Sharing Plaform

ENGLISH

성과물

논문 검색
구분 SCI
연도 ~ 키워드

상세정보

학술지 On the Space-Time Statistics of Motion Pictures
Cited 5 time in scopus Download 0 time Share share facebook twitter linkedin kakaostory
저자
이대열, 고현석, 김종호, Alan C. Bovik
발행일
202107
출처
Journal of the Optical Society of America A, v.38 no.7, pp.908-923
ISSN
1084-7529
출판사
Optical Society of America (OSA)
DOI
https://dx.doi.org/10.1364/JOSAA.413772
협약과제
21HH7300, [통합과제] 초실감 테라미디어를 위한 AV부호화 및 LF미디어 원천기술 개발, 최진수
초록
It is well known that natural images possess statistical regularities that can be captured by bandpass decomposition and divisive normalization processes that approximate early neural processing in the human visual system. We expand on these studies and present new findings on the properties of space-time natural statistics that are inherent in motion pictures. Our model relies on the concept of temporal bandpass (e.g., lag) filtering in lateral geniculate nucleus (LGN) and area V1, which is similar to smoothed frame differencing of video frames. Specifically, we model the statistics of the differences between adjacent or neighboring video frames that have been slightly spatially displaced relative to one another. We find that when these space-time differences are further subjected to locally pooled divisive normalization, statistical regularities (or lack thereof) arise that depend on the local motion trajectory. We find that bandpass and divisively normalized frame differences that are displaced along the motion direction exhibit stronger statistical regularities than for other displacements. Conversely, the direction-dependent regularities of displaced frame differences can be used to estimate the image motion (optical flow) by finding the space-time displacement paths that best preserve statistical regularity.
KSP 제안 키워드
Direction-dependent, Human Visual System(HVS), Image motion, Lateral geniculate nucleus(LGN), Motion direction, Motion pictures, Motion trajectory, Neural processing, Optical Flow, Space time(ST), Statistical regularity