[VASC Seminar Series ]Video Summarization for PVRs

Speaker: Ajay Divakaran, MERL

Time: Wednesday August 15, 12-1pm

Abstract:

We present the world's first highlights-playback-capable Hard Disk Drive
(HDD)-enhanced DVD recorder. It automatically detects highlights in sports
video by detecting portions with a mixture of the commentator's excited
speech and cheering, using Gaussian Mixture Models (GMM's) trained using
the MDL criterion. Our computation is carried out directly on the MDCT
coefficients from the AC-3 coefficients thus giving us a tremendous speed
advantage. Our accuracy of detection of sports highlights is high across a
variety of sports. Our user-study shows that viewers like the new
functionality even if it makes mistakes. Finally, we propose
genre-independent temporal segmentation of non-sports content using
computationally inexpensive audio-visual features. Such segmentation
enables "smart skipping," from one semantic unit to another.

project link