Call for Posters

The ACM Conference on Reproducibility and Replicability invites poster submissions showcasing innovative research and practical insights. Submissions should consist of a 2-page extended abstract, formatted according to the ACM standard conference template, clearly highlighting the contribution’s relevance to reproducibility and replicability. Abstracts will undergo a review for applicability and will be competitively selected based on quality and available poster space. More details here.

Important Dates

Submit –>

We are using the following definitions of reproducibility and replicability as presented in the National Academies of Science, Engineering and Medicine report “Reproducibility and Replication in Science” (overview):

Reproducibility is obtaining consistent results using the same input data, computational steps, methods, and code, and conditions of analysis. This definition is synonymous with “computational reproducibility.”
Replicability is obtaining consistent results across studies aimed at answering the same scientific question, each of which has obtained its own data. Two studies may be considered to have replicated if they obtain consistent results given the level of uncertainty inherent in the system under study.

The ACM REP conference series is associated with the ACM Emerging Interest Group for Reproducibility and Replicability (see here for ACM REP’s history).

All accepted papers will be published in the ACM Digital Library.

Table of Contents: Topics of Interest | Submission Guidelines | Important Dates

Topics of Interest

ACM REP ‘25 welcomes submissions across computing disciplines, spanning both traditional computer science and interdisciplinary scientific computing applications in biology, chemistry, physics, astronomy, genomics, geosciences, etc. The conference particularly values submissions that demonstrate reproducible experimental results. Where full reproduction is not achieved, detailed documentation of the reproducibility experience is equally valuable.

The conference addresses various aspects of reproducibility and replicability, including but not limited to the following topics:

Reproducibility Concepts

Experiment dependency management.
Experiment portability for code, performance, and related metrics.
Software and artifact packaging and container-related reproducibility methods.
Approximate reproducibility.
Record and replay methods.
Data versioning and preservation.
Provenance of data-intensive experiments.
Automated experiment execution and validation.
Reproducibility-aware computational infrastructure.
Experiment discoverability for re-use.
Approaches for advancing reproducibility.

Reproducibility Experiences

Experience of sharing and consuming reproducible artifacts.
Conference-scale artifact evaluation experiences and practices.
Experiences as part of hackathons and summer programs.
Classroom and teaching experiences.
Usability and adaptability of reproducibility frameworks into already-established domain-specific tools.
Frameworks for sociological constructs to incentivize paradigm shifts.
Policies around publication of articles/software.
Experiences within computational science communities.
Collecting datasets from laboratory / real-world settings.

Systems and Security Concerns

Experience comparing published systems in a domain.
Tools to support replicability of system analysis.
Designing machine learning workflows to support reproducibility.
Reproducing real-world security findings.
Privacy concerns arising from reproducibility.
Challenges of reproducing security experiments.
Securing reproducibility infrastructure.

Broader Reproducibility

Cost-benefit analysis frameworks for reproducibility.
Novel methods and techniques that impact reproducibility.
Reusability, repurposability, and replicability methods.
Long-term artifact archiving and verification/testing for future reproducibility.

Submission Guidelines

To submit a poster, authors must upload a 2-page extended abstract via the EasyChair submission site, selecting the Poster option. Submissions must follow the ACM standard conference template and clearly include all content within the required two pages. Abstracts will be evaluated for applicability and quality, and selections will be based on the availability of poster space.

Accepted posters should conform to an A0 portrait format for presentation at the conference.

Authors of accepted posters are expected to present a brief overview of their work during a lightning talk session. Only authors attending the conference in person will receive space to display their posters. Authors unable to attend in person will not be allocated poster space; however, they will still have the opportunity to deliver their lightning talk remotely or via prerecorded presentation.

Submit

For more information or inquiries, please contact Ana Trišović (ana_tris [at] mit.edu).

Important Dates

Poster Submission Deadline: May 26, 2025 (23:59 AoE)
Notification of Acceptance: June 23, 2025
Camera-Ready Submission Deadline: July 14, 2025
Conference Dates: July 29–31, 2025