Institutions | About Us | Help | Gaeilge
rian logo

Go Back
Overview of the CLEF 2018 personalised information retrieval lab (PIR-CLEF 2018)
Pasi, Gabriella; Jones, Gareth J.F.; Curtis, Keith; Marrara, Stefania; Sanvitto, Camilla; Ganguly, Debasis; Sen, Procheta
At CLEF 2018, the Personalised Information Retrieval Lab (PIR-CLEF 2018) has been conceived to provide an initiative aimed at both providing and critically analysing a new approach to the evaluation of personalization in Information Retrieval (PIR). PIR-CLEF 2018 is the first edition of this Lab after the successful Pilot lab organised at CLEF 2017. PIR CLEF 2018 has provided registered participants with the data sets originally developed for the PIR-CLEF 2017 Pilot task; the data collected are related to real search sessions over a subset of the ClueWeb12 collection, undertaken by 10 users by using a novel methodology. The data were gathered during the search sessions undertaken by 10 volunteer searchers. Activities during these search sessions included relevance assessment of a retrieved documents by the searchers. 16 groups registered to participate at PIR-CLEF 2018 and were provided with the data set to allow them to work on PIR related tasks and to provide feedback about our proposed PIR evaluation methodology with the aim to create an effective evaluation task.
Keyword(s): Information retrieval
Publication Date:
Type: Other
Peer-Reviewed: Unknown
Language(s): English
Institution: Dublin City University
Citation(s): Pasi, Gabriella ORCID: 0000-0002-6080-8170 <>, Jones, Gareth J.F. ORCID: 0000-0003-2923-8365 <>, Curtis, Keith, Marrara, Stefania, Sanvitto, Camilla, Ganguly, Debasis ORCID: 0000-0003-0050-7138 <> and Sen, Procheta (2018) Overview of the CLEF 2018 personalised information retrieval lab (PIR-CLEF 2018). In: CLEF 2018 - Conference and Labs of the Evaluation Forum, 10-14 Sept 2018, Avignon, France.
Publisher(s): CEUR-WS
File Format(s): application/pdf
Related Link(s):,
First Indexed: 2019-06-05 06:06:04 Last Updated: 2019-08-01 06:07:34