Institutions | About Us | Help | Gaeilge
rian logo


Mark
Go Back
Semantic analysis of field sports video using a petri-net of audio-visual concepts
Liang, Bai; Lao, Songyang; Smeaton, Alan F.; O'Connor, Noel E.; Sadlier, David A.; Sinclair, David
The most common approach to automatic summarisation and highlight detection in sports video is to train an automatic classifier to detect semantic highlights based on occurrences of low-level features such as action replays, excited commentators or changes in a scoreboard. We propose an alternative approach based on the detection of perception concepts (PCs) and the construction of Petri-Nets which can be used for both semantic description and event detection within sports videos. Low-level algorithms for the detection of perception concepts using visual, aural and motion characteristics are proposed, and a series of Petri-Nets composed of perception concepts is formally defined to describe video content. We call this a Perception Concept Network-Petri Net (PCN-PN) model. Using PCN-PNs, personalized high-level semantic descriptions of video highlights can be facilitated and queries on high-level semantics can be achieved. A particular strength of this framework is that we can easily build semantic detectors based on PCN-PNs to search within sports videos and locate interesting events. Experimental results based on recorded sports video data across three types of sports games (soccer, basketball and rugby), and each from multiple broadcasters, are used to illustrate the potential of this framework.
Keyword(s): Multimedia systems; Digital video; Algorithms; sports video; summarisation
Publication Date:
2009
Type: Other
Peer-Reviewed: Unknown
Language(s): English
Institution: Dublin City University
Citation(s): Liang, Bai, Lao, Songyang, Smeaton, Alan F. ORCID: 0000-0003-1028-8389 <https://orcid.org/0000-0003-1028-8389>, O'Connor, Noel E. ORCID: 0000-0002-4033-9135 <https://orcid.org/0000-0002-4033-9135>, Sadlier, David A. and Sinclair, David (2009) Semantic analysis of field sports video using a petri-net of audio-visual concepts. The Computer Journal, 52 (7). pp. 808-823. ISSN 0010-4620
Publisher(s): Oxford University Press
File Format(s): application/pdf
Related Link(s): http://doras.dcu.ie/15013/3/COMPJ-2007-10-0196-final.pdf,
http://dx.doi.org/10.1093/comjnl/bxn058
First Indexed: 2009-11-21 02:02:12 Last Updated: 2019-02-09 06:57:05