Video Analysis Based on Human Pose for Unsupervised Summarization and Retrieval
Carlos Santiago, Duarte Miguel Alves, Beatriz Quintino Ferreira, João Carvalho, Alberto Messina, João Paulo Costeira
2019 International Conference on Content-Based Multimedia Indexing (CBMI), 2019
Finding good representations for videos is becoming increasingly more important to enable an efficient analysis and comparison, with potential applications in sports, surveillance, news, or web services. This paper proposes a new representation of videos based on human pose. Rather than looking at conventional features, our method relies only on human pose detections to characterize the video. This approach provides a powerful tool for the efficient analysis of videos of human activities, particularly for video summarization and retrieval. We evaluate the proposed representation on the following tasks: 1) computing video statistics, such as the main poses and viewpoint preferences; 2) partitioning videos into a collection of short clips that will compose the video summary; and 3) retrieving frames or scenes with specific poses from videos. Results show that the proposed approach is able to successfully perform these tasks.