Institutions | About Us | Help | Gaeilge
rian logo


Mark
Go Back
Dublin City University and partners’ participation in the INS and VTT tracks at TRECVid 2016
Marsden, Mark; Mohedano, Eva; McGuinness, Kevin; Calafell, Andrea; Giró-i-Nieto, Xavier; O'Connor, Noel E.; Zhou, Jiang; Azevedo, Lucas; Daudert, Tobias; Davis, Brian; Hurlimann, Manuela; Afli, Haithem; Du, Jinhua; Ganguly, Debasis; Li, Wei B.; Way, Andy; Smeaton, Alan F.
Dublin City University participated with a consortium of colleagues from NUI Galway and Universitat Politecnica de Catalunya in two tasks in TRECVid 2016, Instance Search (INS) and Video to Text (VTT). For the INS task we developed a framework consisting of face detection and representation and place detection and representation, with a user annotation of top-ranked videos. For the VTT task we ran 1,000 concept detectors from the VGG-16 deep CNN on 10 keyframes per video and submitted 4 runs for caption re-ranking, based on BM25, Fusion, word2vec and a fusion of baseline BM25 and word2vec. With the same pre-processing for caption generation we used an open source image-to-caption CNN-RNN toolkit NeuralTalk2 to generate a caption for each keyframe and combine them.
Keyword(s): Imaging systems; Computational linguistics; Machine learning; Artificial intelligence; Multimedia systems; Image processing; Digital video; Semantic Concept; Video Captions
Publication Date:
2016
Type: Other
Peer-Reviewed: Unknown
Language(s): English
Institution: Dublin City University
Citation(s): Marsden, Mark, Mohedano, Eva, McGuinness, Kevin ORCID: 0000-0003-1336-6477 <https://orcid.org/0000-0003-1336-6477>, Calafell, Andrea, Giró-i-Nieto, Xavier ORCID: 0000-0002-9935-5332 <https://orcid.org/0000-0002-9935-5332>, O'Connor, Noel E. ORCID: 0000-0002-4033-9135 <https://orcid.org/0000-0002-4033-9135>, Zhou, Jiang ORCID: 0000-0002-3067-8512 <https://orcid.org/0000-0002-3067-8512>, Azevedo, Lucas, Daudert, Tobias, Davis, Brian, Hurlimann, Manuela, Afli, Haithem ORCID: 0000-0002-7449-4707 <https://orcid.org/0000-0002-7449-4707>, Du, Jinhua, Ganguly, Debasis ORCID: 0000-0003-0050-7138 <https://orcid.org/0000-0003-0050-7138>, Li, Wei B., Way, Andy ORCID: 0000-0001-5736-5930 <https://orcid.org/0000-0001-5736-5930> and Smeaton, Alan F. ORCID: 0000-0003-1028-8389 <https://orcid.org/0000-0003-1028-8389> (2016) Dublin City University and partners’ participation in the INS and VTT tracks at TRECVid 2016. In: TRECVid Conference, 14-16 Nov 2016, Gaithersburg, Md., USA.
File Format(s): application/pdf
Related Link(s): http://doras.dcu.ie/21484/1/TRECVid2016%287%29.pdf
First Indexed: 2016-12-02 07:23:05 Last Updated: 2019-05-17 06:09:56