Institutions | About Us | Help | Gaeilge
rian logo


Mark
Go Back
Towards evaluation of personalized and collaborative information retrieval
Ganguly, Debasis; Leveling, Johannes; Li, Wei B.; Jones, Gareth J.F.
We propose to extend standard information retrieval (IR) ad-hoc test collection design to facilitate research on personalized and collaborative IR by gathering additional meta-information during the topic (query) development process. We propose a controlled query generation process with activity logging for each topic developer. The standard ad-hoc collection will thus be accompanied by a new set of thematically related topics and the associated log information, and has the potential to simulate a real-world search scenario to encourage retrieval systems to mine user information from the logs to improve IR effectiveness. The proposed methodology described in this paper will be applied in a pilot task which is scheduled to run in the FIRE 2011 evaluation campaign. The task aims at investigating the research question of whether personalized and collaborative IR retrieval experiments and evaluation can be pursued by enriching a standard ad-hoc collection with such meta-information.
Keyword(s): Information retrieval; query development; relevance
Publication Date:
2011
Type: Conference item
Peer-Reviewed: Yes
Language(s): English
Institution: Dublin City University
Citation(s): Ganguly, Debasis and Leveling, Johannes and Li, Wei B. and Jones, Gareth J.F. (2011) Towards evaluation of personalized and collaborative information retrieval. In: The First Workshop on Personalised Multilingual Hypertext Retrieval (PMHR 2011), 6th June 2011, Eindhoven, The Netherlands.
File Format(s): application/pdf
Related Link(s): http://doras.dcu.ie/16390/1/Towards_Evaluation_of_Personalized_and_Collaborative_Information_Retrieval.pdf
First Indexed: 2011-06-30 05:13:31 Last Updated: 2016-11-04 05:08:37