repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Documents
- Fulltext
Submitted manuscript, 426 KB, PDF document
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented Information Retrieval (IR) experiments. The corresponding Python package provides IR researchers with measures for different levels of reproduction when evaluating their systems’ outputs. By offering an easily extensible interface, we hope to stimulate common practices when conducting a reproducibility study of system-oriented IR experiments.
| Original language | English |
|---|---|
| Title of host publication | Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Proceedings |
| Editors | Djoerd Hiemstra, Marie-Francine Moens, Josiane Mothe, Raffaele Perego, Martin Potthast, Fabrizio Sebastiani |
| Number of pages | 6 |
| Publisher | Springer |
| Publication date | 2021 |
| Pages | 481-486 |
| ISBN (Print) | 9783030722395 |
| DOIs | |
| Publication status | Published - 2021 |
| Event | 43rd European Conference on Information Retrieval, ECIR 2021 - Virtual, Online Duration: 28 Mar 2021 → 1 Apr 2021 |
Conference
| Conference | 43rd European Conference on Information Retrieval, ECIR 2021 |
|---|---|
| By | Virtual, Online |
| Periode | 28/03/2021 → 01/04/2021 |
| Series | Lecture Notes in Computer Science |
|---|---|
| Volume | 12657 LNCS |
| ISSN | 0302-9743 |
Bibliographical note
Publisher Copyright:
© 2021, Springer Nature Switzerland AG.
- Evaluation, Replicability, Reproducibility
Research areas
ID: 306679515