Two tracks of test video
Affective frame segmentation
Multiple linear regression method
Single highlight results
Single highlight results
ABSTRACT:
Video highlights are sequences of frames that impressed us most. We memorized the exciting, entertaining or interesting parts of video. For example, in football games, we consider the scene of a shot as a highlight. In previous works, most highlight frames in video were extracted using the content. However, the highlight extraction results did not completely match the emotion feedbacks of viewers due to the lack of consideration in the viewer reaction. In order to solve this problem, we present a highlight extraction system based on viewer’s affections. This work consists of several stages: video collecting, preprocessing, and highlight extraction. In our thesis, we focus on video highlight extraction. We calculate viewers’ expression intensity and normalize the distribution curve of their emotion feedbacks to extract video highlights. Our approach can couple with two modes. We can extract video highlights according to everybody’s preferences parts of videos in single viewer mode. We extended our method to multi viewer evaluation in order to decrease personal preferences toward different kinds of video.
SUMMARY (中文總結):
影片的醒目片段是一幕幕令我們感到印象深刻的畫面。我們通常會對刺激的、娛樂性高的或者是有趣的影片片段比較有印象，舉例來說:我們把射門的場景當成是足球比賽影片中的醒目片段。在之前的相關研究中，大部分的論文會用影片的內容來擷取影片中醒目片段。然而，由於這些方法沒有考慮觀賞者的反應，造成影片醒目片段的擷取結果可能和觀賞者真實的情緒反應不完全相符，因此，為了解決這個問題，我們提出一個基於觀看者的情緒狀態來擷取視訊醒目片段的系統。這個方法包含幾個階段:影片的蒐集，前處理和影片醒目片段的擷取。在我們論文中，我們著重於影片醒目片段的擷取，我們計算觀賞者表情的強度和正規化使用者情緒反應的分布曲線來取得醒目片段。我們的方法可以處理單人及多人的模式。在單人模式中，我們可以取得每個人對影片的喜好部分，然而，為了降低因為每個人對不同種類的影片有個別偏好，我們把方法擴增到多人模式。
References
1.
Youtube, “Andy and Jacqueline Brave the Haunted House”, URL
https://www.youtube.com/watch?v=vEVrYx8-lys&index=3&list=PLh9NzMEbvgQJ84qQJOiVOx91vWfpZtzZB
2.
F. Wallhoff. 2005. The Facial Expressions and Emotions Database Homepage (FEEDTUM). URL
https://www.mmk.ei.tum.de /?waf/fgnet/feedtum.html/
3.
Youtube, “Ellen's Favorite Scares”, URL
https://www.youtube.com/watch?v=oJsYwehp_r4