Institutions | About Us | Help | Gaeilge
rian logo

Go Back
A Real-time Framework for Video Time and Pitch Scale Modification
Damnjanovic, Ivan; Barry, Dan; Dorran, David; Reiss, Josh
<p>A framework is presented which addresses the issues related to the real-time implementation of synchronised video and audio time-scale and pitch-scale modification algorithms. It allows for seamless real-time transition between continually varying, independent time-scale and pitch-scale parameters arising as a result of manual or automatic intervention. We illuminate the problems which arise in a real-time context as well as provide novel solutions to prevent artefacts, minimise latency, and improve synchronisation. The time and pitch scaling approach is based on a modified phase vocoder with optional phase locking and an integrated transient detector which enables high quality transient preservation in real-time. A novel method for audio/visual synchronisation was implemented in order to ensure no perceptible latency between audio and video while real-time time scaling and pitch shifting is applied. Evaluation results are reported which demonstrate both high audio quality and minimal synchronisation error.</p>
Keyword(s): video; pitch; framework; real time; 2.2 ELECTRICAL, ELECTRONIC, INFORMATION ENGINEERING; Signal Processing
Publication Date:
Type: Conference item
Peer-Reviewed: No
Contributor(s): European Community
Institution: Dublin Institute of Technology
Citation(s): Damnjanovic, I. et al. (2008) A Real-Time Framework for Video Time and Pitch Scale Modification. Proc. of the <i>11th International. Conference on Digital Audio Effects (DAFx-08)</i>, Espoo, Finland, September 1-4, 2008.
Publisher(s): Dublin Institute of Technology
File Format(s): application/pdf
First Indexed: 2011-01-14 05:35:08 Last Updated: 2017-04-26 13:38:27