Call for Tutorials

The 2024 ACM Conference on Reproducibility and Replicability (ACM REP ‘24) aims to bring together experts and practitioners engaged in the advancement and conduct of reproducible science in computing disciplines. The first-of-its-kind conference will serve as a premier forum for the exchange and presentation of the concepts, tools, techniques, practice and state-of-art in reproducible science. The conference committee invites tutorials related to reproducibility and independent verification.

We are using the following definitions of reproducibility and replicability as presented in the National Academies of Science, Engineering and Medicine report “Reproducibility and Replication in Science” (overview):

Reproducibility is obtaining consistent results using the same input data, computational steps, methods, and code, and conditions of analysis. This definition is synonymous with “computational reproducibility.”
Replicability is obtaining consistent results across studies aimed at answering the same scientific question, each of which has obtained its own data. Two studies may be considered to have replicated if they obtain consistent results given the level of uncertainty inherent in the system under study.

The ACM REP conference series is associated with the ACM Emerging Interest Group for Reproducibility and Replicability (see here for ACM REP’s history).

Topics of Interest

Tutorial submissions are encouraged on any topic area of interest listed in the Call for Papers.

Submission Guidelines

Tutorial proposals should be submitted in PDF format via the paper submission site. The authors should follow the single-column ACM format (see acmsmall) .

Proposal Information

Title and abstract of the tutorial
Name, email address, affiliation and brief professional biography of the tutorial instructor(s).
Tutorial description:
- learning objectives of the tutorial and relevance to ACM REP 2024
- targeted audience (introductory, intermediate, advanced) and prerequisite knowledge or skills; a brief outline of the tutorial structure; practical sessions.
Tutorial length: full (6 hours) or half day (3 hours).
Any special equipment/software needs for the tutorial

Tutorial Online Presence

Accepted tutorials will be required to prepare a tutorial web page containing detailed information about the tutorial content, schedule and organization. Tutorial organizers are also responsible for the timely production and distribution of all material to be used during the tutorial (slides, notes, technical articles, etc.). In the case of a hands-on tutorial requiring software, it is strongly recommended that organizers place any software prerequisites online for participants to download and install before the start of the tutorial.

Tutorial Format

We encourage tutorial proponents to decide and motivate if and why their tutorial works (only) in an in-person, hybrid, or online format.

Evaluation Criteria

The decision on acceptance or rejection of tutorial proposals will be made on the basis of the overall quality of the proposal and its appeal to a reasonable fraction of the ACM REP community.

In particular, tutorials are encouraged to consider the following guidelines:

The research topic falls in the general scope of the conference.
There is a clear focus on a specific technology, problem or application.
There is an anticipation of a sufficiently large community interested in the topic.
There is a concrete plan for the tutorial format including exercises or other types of hands-on work.

All submitted tutorial proposals will be evaluated based on the following criteria:

ability of the tutorial to contribute to strengthening the ACM REP community;
clarity and quality of the tutorial, which should emerge from its description;
good organization, as appearing from the outline;
the value of any materials released with the tutorial for the community; background/experience of tutorial instructor(s) in teaching the target topics.

Tutorial Chairs

Reed Milewicz (Sandia National Laboratories)
Line Pouchard (Brookhaven National Laboratory)

Contact Information

For questions and more details, please contact the tutorial organizer at acmrep24-info-group@ucsc.edu.

Important Dates

Paper submission (Long and Short): ~~January 29~~ February 12 16, 2024, 23:59 AOE
Notification of acceptance: May 3, 2024
Early-bird registration close: ~~May 31~~ June 8, 2024
Registration close: ~~June 8~~ June 20, 2024
Conference: June 18-20, 2024