Reproducibility Track Chairs:
↗ Ziawasch Abedjan (TU Berlin)
↗ Lawrence Benson (TUM)
Reproducibility Committee:
tba
Description
We believe that sharing experimental code, data and setup will benefit scientific progress, foster collaboration and exchange of ideas. We would like to build a culture where sharing results, code, and scripts is the norm rather than an exception. This way, we want to highlight the impact and credibility of database research papers. BTW 2025 has invited all authors of accepted papers to participate in the Reproducibility Track.
The Reproducibility Initiative/Track is running for the second time. The BTW Reproducibility Initiative has the following goals:
Highlight the impact and credibility of database research papers.
Enable repeatable and shareable research by easy sharing of code and experimental setups.
Facilitate easy dissemination of research results
Participation implies:
To easily repeat your own experiments.
To discover accidental flaws and improve your results.
To increase confidence in your results.
To make it easy for other researchers to compare to, adopt and extend your research.
To increase visibility and impact of your results.
Successful papers will be advertised at the conference and will receive a Reproducibility label in the proceedings.
Participation
We encourage the participants to exactly follow the SIGMOD guidelines for reproducibility, which has shown to be successfully implemented in previous years.
At a minimum participating authors were required to provide a complete set of scripts to install the system, produce the data, run experiments and produce the resulting graphs along with a detailed Readme file that describes the process step by step so it could be easily and independently reproduced by a reviewer.
The ideal reproducibility submission consists of a master script that:
installs all systems needed,
generates or fetches all needed input data,
reruns all experiments and generates all results,
generates all graphs and plots, and finally,
recompiles the sources of the paper
. . . to produce a new PDF for the paper that contains the new graphs. It is possible!
Scope
The Reproducibility Initiative/Track is open to the accepted papers of the BTW Research Track.