ECIR strongly encourages the submission of papers that repeat, reproduce, generalise, and analyse prior work. Please refer to the ACM “Artifact Review and Badging” guidelines for consistent use of the terminology, which is heterogeneous across disciplines.

In particular, we solicit replicability (different team, same experimental setup) and reproducibility (different team, different experimental setup) papers. Submissions from the same authors – i.e., repeatability (same team, same experimental setup) papers – of the reproduced experiments will not be accepted.

Reproducibility is key for establishing research to be reliable, referenceable, and extensible for the future. Emphasise your motivation for selecting the paper/papers, the process of how results have been attempted to be reproduced (successful or not), the communication that was necessary to gather all information, the potential difficulties encountered, and the result of the process. A successful reproduction of the work is not a requirement, but it is crucial to provide a precise and rigid evaluation of the process to allow lessons to be learned for the future.

Reproducibility Paper Track Dates

• Reproducibility paper abstract submission: October 16, 2024, 11:59pm (AoE) October 23, 2024, 11:59pm (AoE)
• Reproducibility paper submission: October 23, 2024, 11:59pm (AoE) October 30, 2024, 11:59pm (AoE)
• Reproducibility paper notification: December 16, 2025
• Main conference: April 6-10, 2025

Read more information HERE.