Overview of CENTRE@CLEF 2018: A first tale in the systematic reproducibility realm

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

Original languageEnglish
Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 9th International Conference of the CLEF Association, CLEF 2018, Proceedings
EditorsEric SanJuan, Fionn Murtagh, Jian Yun Nie, Laure Soulier, Linda Cappellato, Patrice Bellot, Josiane Mothe, Chiraz Trabelsi, Nicola Ferro
Number of pages8
Publication date1 Jan 2018
ISBN (Print)9783319989310
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event9th International Conference of the CLEF Association, CLEF 2018 - Avignon, France
Duration: 10 Sep 201814 Sep 2018


Conference9th International Conference of the CLEF Association, CLEF 2018
SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11018 LNCS

ID: 216516759