Institutions | About Us | Help | Gaeilge
rian logo

Go Back
A Real-time Framework for Video Time and Pitch Scale Modification
Damnjanovic, Ivan; Barry, Dan; Dorran, David; Reiss, Josh
A framework is presented which addresses the issues related to the real-time implementation of synchronised video and audio time-scale and pitch-scale modification algorithms. It allows for seamless real-time transition between continually varying, independent time-scale and pitch-scale parameters arising as a result of manual or automatic intervention. We illuminate the problems which arise in a real-time context as well as provide novel solutions to prevent artefacts, minimise latency, and improve synchronisation. The time and pitch scaling approach is based on a modified phase vocoder with optional phase locking and an integrated transient detector which enables high quality transient preservation in real-time. A novel method for audio/visual synchronisation was implemented in order to ensure no perceptible latency between audio and video while real-time time scaling and pitch shifting is applied. Evaluation results are reported which demonstrate both high audio quality and minimal synchronisation error.
Keyword(s): video; pitch; framework; real time; Signal Processing
Publication Date:
Type: Conference item
Peer-Reviewed: Unknown
Contributor(s): European Community
Institution: Dublin Institute of Technology
Citation(s): Conference papers
Publisher(s): Dublin Institute of Technology
File Format(s): application/pdf
First Indexed: 2011-01-14 05:35:08 Last Updated: 2017-12-14 06:44:32