Salient region detection and tracking in video

Abstract

A new approach to automatically detect and track salient regions in generic videos is presented in this paper. Specifically, given a starting video frame, we first detect its salient regions based on extracted color and orientation maps; then we track these regions for the rest of frames within a short period of time. The extracted salient region information could be used to evaluate the frame importance so as to provide guidance in keyframe extraction for video summarization purpose. Experiments on four test video sequences have yielded encouraging results.