ICADL 2007 - LNCS 4822

Annotations and Digital Libraries: Designing Adequate Test-Beds

Maristella Agosti, Tullio Coppotelli^*, Nicola Ferro, and Luca Pretto

Department of Information Engineering, University of Padua, Italy
agosti@dei.unipd.it
coppotel@dei.unipd.it
ferro@dei.unipd.it
pretto@dei.unipd.it

Abstract. The increasing number of users and the diffusion of Digital Libraries (DLs) has increased the demand for newer and improved systems to give better assistance to the user during the search of resources in collections managed by Digital Library Systems (DLSs). In this perspective, the annotations made on documents offer an interesting possibility for improving both the user experience of the DLS and the retrieval performance of the system itself. However, while different approaches based on annotations have been proposed, they still lack a full experimental evaluation, mainly because an experimental collection with annotation is missing. Therefore, this paper addresses the problem of setting an adequate experimental test-bed for DL search algorithms which exploit annotations, and discusses a flexible strategy for creating test collections with annotated documents.

^*The work of Tullio Coppotelli has been partially supported by a grant of MicroWave Network S.p.A., Padua, Italy.

LNCS 4822, p. 150 ff.

Full article in PDF | BibTeX