Institutions | About Us | Help | Gaeilge
rian logo


Mark
Go Back
Informed perspectives on human annotation using neural signals
Healy, Graham; Gurrin, Cathal; Smeaton, Alan F.
In this work we explore how neurophysiological correlates related to attention and perception can be used to better understand the image-annotation task. We explore the nature of the highly variable labelling data often seen across annotators. Our results indicate potential issues with regard to ‘how well’ a person manually annotates images and variability across annotators. We propose such issues arise in part as a result of subjectively interpretable instructions that may fail to elicit similar labelling behaviours and decision thresholds across participants. We find instances where an individual’s annotations differ from a group consensus, even though their EEG (Electroencephalography) signals indicate in fact they were likely in consensus with the group. We offer a new perspective on how EEG can be incorporated in an annotation task to reveal information not readily captured using manual annotations alone. As crowd-sourcing resources become more readily available for annotation tasks one can reconsider the quality of such annotations. Furthermore, with the availability of consumer EEG hardware, we speculate that we are approaching a point where it may be feasible to better harness an annotators time and decisions by examining neural responses as part of the process. In this regard, we examine strategies to deal with inter-annotator sources of noise and correlation that can be used to understand the relationship between annotators at a neural level.
Keyword(s): Information retrieval; Brain-computer interface; EEG; HCI; Semantic
Publication Date:
2016
Type: Other
Peer-Reviewed: Unknown
Language(s): English
Institution: Dublin City University
Citation(s): Healy, Graham ORCID: 0000-0001-6429-6339 <https://orcid.org/0000-0001-6429-6339>, Gurrin, Cathal ORCID: 0000-0003-2903-3968 <https://orcid.org/0000-0003-2903-3968> and Smeaton, Alan F. ORCID: 0000-0003-1028-8389 <https://orcid.org/0000-0003-1028-8389> (2016) Informed perspectives on human annotation using neural signals. In: The 22nd International Conference on Multimedia Modeling, 4-6 Jan 2016, Miami, FL.. ISBN 978-3-319-27673-1
Publisher(s): Springer
File Format(s): application/pdf
Related Link(s): http://doras.dcu.ie/21017/1/llncs_doras.pdf
First Indexed: 2016-01-14 05:11:56 Last Updated: 2019-02-09 06:19:40