Registered
METHOD AND SYSTEM FOR RETRIEVING VIDEO SEGMENT BY A SEMANTIC QUERY
- Inventors
-
- Application No.
-
17881151 (2022.08.04)
- Publication No.
-
20230083476 (2023.03.16)
- Registration No.
- 12019678 (2024.06.25)
- Country
- UNITED STATES
- Project Code
-
21HS4800, Development of Previsional Intelligence based on Long-term Visual Memory Network,
Moon Jin Young
-
21HS4600, Development of High Performance Visual Discovery Platform for Realtime and Large-Scale Data Analysis and Prediction,
Bae Yu Seok
- Abstract
- Provided is a method of detecting a semantics section in a video. The method includes extracting all video features by inputting an inputted video to a pre-trained first deep neural network algorithm, extracting a query sentence feature by inputting an inputted query sentence to a pre-trained second deep neural network algorithm, generating video-query relation integration feature information in which all of the video features and the query sentence feature have been integrated by inputting all of the video features and the query sentence feature to a plurality of scaled-dot product attention layers, and estimating a video segment corresponding to the query sentence in the video based on the video-query relation integration feature information.
- KSP Keywords
- Deep neural network(DNN), Dot product, Feature information, Integration feature, Network Algorithm, Neural network algorithm, Semantic query, Video Features, neural network, video based, video segment
- Family
-