Evaluation of contextual information retrieval effectiveness: overview of issues and research |
| |
Authors: | Lynda Tamine-Lechani Mohand Boughanem Mariam Daoud |
| |
Affiliation: | (1) Department of Medical Informatics & Clinical Epidemiology, Oregon Health & Science University, 3181 SW Sam Jackson Park Rd., BICC Portland, OR USA, 97239 |
| |
Abstract: | The increasing prominence of information arising from a wide range of sources delivered over electronic media has made traditional
information retrieval systems less effective. Indeed, users are overwhelmed by the information delivered by such systems in
response to their queries, particularly when the latter are ambiguous. In order to tackle this problem, the state-of-the-art
reveals that there is a growing interest towards contextual information retrieval which relies on various sources of evidence
issued from the user’s search background and environment like interests, preferences, time and location, in order to improve
the retrieval accuracy. Contextual information retrieval systems are based on different definitions of the core concept of
user’s context, various user’s context modeling approaches and several techniques of document relevance measurement, but all
share the goal of providing the most useful information to the users in accordance with their context. However, the evaluation
methodologies conceived in the past several years for traditional information retrieval and widely used in the evaluation
campaigns have been challenged by the consideration of user’s context in the information retrieval process. Thus, we recognize
that a critical review of existing evaluation methodologies in contextual information retrieval area is needed in order to
design and develop standard evaluation frameworks. We present in this paper a comprehensive survey of contextual information
retrieval evaluation methodologies and provide insights into how and why they are appropriate to measure the retrieval effectiveness.
We also highlight some of the research challenges ahead that would constitute substantive research area for future research. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|