Call for Posters

The ACM Conference on Reproducibility and Replicability is open for poster submissions. Each submission will consist of a 2-page extended abstract, including all content, following the ACM standard conference template. These 2-page abstracts will be reviewed for applicability and downselected for quality based on available poster space. More details here.

Submit –>

We are using the following definitions of reproducibility and replicability as presented in the National Academies of Science, Engineering and Medicine report “Reproducibility and Replication in Science” (overview):

Reproducibility is obtaining consistent results using the same input data, computational steps, methods, and code, and conditions of analysis. This definition is synonymous with “computational reproducibility.”
Replicability is obtaining consistent results across studies aimed at answering the same scientific question, each of which has obtained its own data. Two studies may be considered to have replicated if they obtain consistent results given the level of uncertainty inherent in the system under study.

The ACM REP conference series is associated with the ACM Emerging Interest Group for Reproducibility and Replicability (see here for ACM REP’s history). All accepted papers will be published by ACM - International Conference Proceedings Series (ICPS) and will be available in the ACM Digital Library.

Table of Contents: Topics of Interest | Submission Guidelines | Important Dates

Topics of Interest

Topics of interest include, but are not limited to, the following as they relate to various aspects of reproducibility and replicability.

Computational Reproducibility Concepts

Experiment dependency management.
Experiment portability for code, performance, and related metrics.
Software and artifact packaging and container-related reproducibility methods.
Approximate reproducibility.
Record and replay methods.
Data versioning and preservation.
Provenance of data-intensive experiments.
Automated experiment execution and validation.
Reproducibility-aware computational infrastructure.
Experiment discoverability for re-use.
Approaches for advancing reproducibility.
Numerical results reproducibility, Statistical reproducibility

Computational Reproducibility Experiences

Experience of sharing and consuming reproducible artifacts.
Conference-scale artifact evaluation experiences and practices.
Experiences as part of hackathons and summer programs.
Classroom and teaching experiences.
Usability and adaptability of reproducibility frameworks into already-established domain-specific tools.
Frameworks for sociological constructs to incentivize paradigm shifts.
Policies around publication of articles/software.
Experiences within computational science communities

Broader Reproducibility

Cost-benefit analysis frameworks for reproducibility.
Novel methods and techniques that impact reproducibility.
Reusability, repurposability, and replicability methods.
Long-term artifact archiving and verification/testing for future reproducibility.

Submission Guidelines

To submit a 2-page extended abstract for a poster, please use EasyChair submission site and choose the Posters track (https://easychair.org/conferences/?conf=acmrep24). Each submission needs to consist of a 2-page extended abstract, including all content, following the ACM standard conference template. These 2-page abstracts will be reviewed for applicability and downselected for quality based on available poster space.

Posters selected for presentation at the conference must fit within an A0 portrait size.

Authors of accepted poster submissions are expected to give a short talk about their poster in a lightening talk session. Of these authors only those who attend in person will get poster space. Of those who are not able to attend in person will not be given poster space but will still be able to present a remote/prerecorded lightening talk.

Submit –>

For questions, please contact Jay Lofstead (gflofst@sandia.gov).

We look forward to your submissions!

Jay and Tanu
ACM Rep 2024 co-General Chairs

Important Dates

Poster submissions: May 3, 2024, 23:59 AOE
Notification of acceptance: May 10, 2024
Early-bird registration close: ~~May 31~~ June 8, 2024
Registration close: ~~June 8~~ June 20, 2024
Conference: June 18-20, 2024