ACM REP 2027

Attempt to rerun, reproduce and replicate Clinical Trials Sentence Classification Studies: lessons learnt

Fri, 25 Jul 2025 00:00:00 +0000

Experience with Reproducibility and Consistency in Writing an Academic Paper

Fri, 25 Jul 2025 00:00:00 +0000

LLMs in Citation Intent Classification: Progress, Precision, and Reproducibility Challenges

Fri, 25 Jul 2025 00:00:00 +0000

Posters

Fri, 25 Jul 2025 00:00:00 +0000

Toward a Systematic Assessment of Map Reproduction Success Using OCR

Fri, 25 Jul 2025 00:00:00 +0000

Travel & Venue

Mon, 16 Oct 2023 00:00:00 +0000

Featured Keynote Speakers

Fri, 31 Mar 2023 00:00:00 +0000

Mon, 01 Jan 0001 00:00:00 +0000

Agenda

Mon, 01 Jan 0001 00:00:00 +0000

Code of Conduct

Mon, 01 Jan 0001 00:00:00 +0000

The steering committee of ACM REP ‘24 believes in respect, compassion, understanding and inclusion and we expect all community members to act in accordance with these values. Fostering the free exchange of ideas requires building a conference that welcomes people of all backgrounds. Diversity of opinion and background is a fundamental strength of our community. The members of our community must have the freedom to espouse and explore a wide range of ideas. Toward that goal, ACM REP ‘24 aims to create spaces where every participant can express themselves without fear of judgment or harassment.

The ACM REP Code of Conduct guides the expected, professional behavior of conference participants, including:

Treating everyone with respect and consideration; under the umbrella of respect, we expect all participants to be mindful of their speech and behaviors both in person and online.
Communicating openly and thoughtfully with others and being considerate of the multitude of views and opinions that may be different than your own.
Being respectful and mindful in your critique of ideas.
Being mindful of your fellow participants, including (but not limited to):
- Respecting participants wishes to not be photographed;
- Respecting participant gender pronouns; and
- Respecting the space of others and their right to engage or not engage in conversation.

We believe differences of opinion are a natural part of social and academic life and are important to work through when building community and learning from one another. At the same time, we acknowledge that societal power structures are even more challenging in academia, which is an inherently hierarchical community. In order to foster an environment of inclusion, we do not tolerate harassment, discrimination, or abuse in any form. Participants who engage in harassment may be removed from the conference at the discretion of the organizers.

Unacceptable behaviors include, but are not limited to:

intimidating, harassing, abusive, discriminatory, derogatory or demeaning speech or actions by any participant in ACM-REP activities, at all related events and in one-on-one communications carried out in the context of conference activities;
offensive, degrading, humiliating, harmful, or prejudicial verbal or written comments or visual images related to gender, sexual orientation, race, religion, disability, age, appearance, or other personal characteristics;
unwelcome sexual advances, requests for sexual favors, or other verbal/physical conduct of a sexual nature;
inappropriate or gratuitous use of nudity, sexual images, or stereotyped images including using an activity-related communication channel to display or distribute sexually explicit or otherwise offensive or discriminatory images or messages;
deliberate intimidation, stalking or following;
harassing photography or recording;
sustained disruption of talks or other events;
unwelcome and uninvited attention or contact;
physical assault (including unwelcome touch or groping);
real or implied threat of physical harm;
real or implied threat of professional or financial damage or harm.

Harassment can occur when there is no deliberate intention to offend. Be careful in the words that you choose. Harassment committed in a joking manner or disguised as a compliment still constitutes unacceptable behavior. Remember that sexist, racist, and other exclusionary jokes can be offensive to those around you.

Consequences of Unacceptable Behavior

If an ACM-REP participant engages in prohibited behavior, the conference committee reserves the right to take any action the committee deems appropriate, including removing the participant from the conference.

How to Report Unacceptable Behavior

In the event of unacceptable behavior, participants may wish to inform a person in authority. During ACM REP, participants should reach out to one of the General or Program Chairs (see list below). These individuals can provide information about the process for handling complaints or handling immediate onsite needs.

There may be cases (such as those involving Title IX issues in the United States and venue- or employer-specific policies) where an on-site person who is informed of harassment will be required to file a complaint.

General Chair: Alex Voulimeneas
Program Chairs: Georgios Portokalidis & Soham Chakraborty

This code of content was adapted from the Policy Against Harassment at ACM Activities and the ACM CSCW 2019 conference code of conduct.

Diversity & Inclusion

Mon, 01 Jan 0001 00:00:00 +0000

ACM REP is committed to Diversity, Equity, and Inclusion in Computing and Reproducibility.

Following the model set forth by the overall ACM community, the ACM REP community encompasses the wide range and diverse set of professionals working on reproducibility and computing, from educators and researchers to software and hardware developers, system engineers, project managers, and data scientists.

As noted by the ACM, “Diversity is achieved when the individuals around the table are drawn from a variety of backgrounds and experience, leading to a breadth of viewpoints, reasoning, and approaches […] Equity is achieved by supporting the participation of marginalized communities in computing as well as by promoting impartiality and fairness within the procedures, processes, and distribution of resources and systems […] [and] Inclusion is achieved when the environment is characterized by behaviors that welcome and embrace diversity.”

ACM REP is committed to creating an environment that welcomes new ideas and perspectives, and where hostility or other antisocial behaviors are not tolerated. Conference organizers welcome participation and contribution from participants representing different ages, races, genders and sexual orientation, nationality, physical ability, thinking style and experiences to enhance the overall richness in providing quality programs and services for the global community. We also recognize the need to make services, activities, events, etc. more inclusive for individuals with disabilities. We are open to make accommodations and arrangements so that all those interested can participate fully in our events and activities.

Health & Safety

Mon, 01 Jan 0001 00:00:00 +0000

Under construction – Will be completed soon. The text below is just a placeholder.

We are delighted to welcome attendees to our meeting at INRIA, Rennes University, while also acknowledging continued concerns about the spread of COVID and other health and safety issues. Our team is monitoring the latest guidance and regulations, and our policies align with public health orders. We will follow venue and local regulations regarding masking, distancing, and related health measures.

Proof of COVID-19 vaccinations or a recent negative COVID-19 test result is currently not required for this event. However, If you are feeling sick or test positive for COVID, do not attend the meeting. We are relying on the responsible behavior of our attendees. We encourage but do not require the wearing of masks by attendees. Masks will be made available at the conference venue. Note that for all hospitality related activities, attendees will have the option to eat meals or partake in coffee breaks outdoors if they desire.

If there are any changes in vaccination and/or masking requirements, participants will be emailed prior to the meeting and new requirements will be posted on this page.

We kindly ask that attendees please consult and follow TBD guidelines for quarantine and isolation and travel (as they may change) prior to traveling for the meeting.

During the meeting, participants are encouraged to:

Monitor for symptoms of COVID each morning before coming to the meeting.
Consider bringing a rapid COVID test kit in case you experience symptoms.
Wear a high-quality mask

If you experience symptoms of COVID and/or test positive for COVID while attending ACM REP, you are strongly requested to:

Notify colleagues that they may have been exposed.
Adjust your accommodations and travel plans to follow TBD guidelines for quarantining.
Refrain from attending any meeting events.

Housing

Mon, 01 Jan 0001 00:00:00 +0000

Hotels

Under construction – Will be completed soon.

Registration

Mon, 01 Jan 0001 00:00:00 +0000

Registration fees

Early bird (if registered by June 15, 2026) and regular registration fees (after June 15, 2026):

ACM Professional Member: €750 (regular: €850)
Non-Member: €850 (regular: €880)
ACM Student Member: €380 (regular: €450)
Student Non-member: €450 (regular: €500)
Dinner Reception: €70 (regular: €80)

In-person registration includes: access to all sessions and tutorials, breaks and lunches on each day, and Dinner Reception. Please note that additional Dinner Reception tickets for non-registered persons are available.

A limited number of free student registrations are available on request to attend the conference virtually. We particularly encourage people from underrepresented groups to contact us.

Important Dates

Early-bird registration close: June 15
Author registration close: July 6
Conference: July 20-22, 2026

Terms and Conditions

Authors

For each article accepted at ACM REP 2026, it is required to have at least one of the authors registered at the conference, with the commitment to present it at the conference - online presentations are accepted but require full on site registration as well. Paper without a full registration will be withdrawn from the program and the proceedings. The deadline for author registration is July 6, 2025.

Students

Student fees are applicable only to full-time students. Students must be able to provide a proof of their student status (student ID card or certificate).

Cancellation Policy

If a registrant is unable to attend an event for any reason they may substitute, by arrangement with the conference organizers, someone else from the same institute/organization.

Tutorials, Presentations, and Workshops

Mon, 01 Jan 0001 00:00:00 +0000

Presentation: A Reproducibility Check Service for Computational Research

When: Monday, July 20 2026, 15:45-16:30

Where: ECHO Building

Authors: Yasel Quintero, TU Delft (y.i.quinterolares@tudelft.nl), Joao Guimaraes, TU Delft (j.guimaraes@tudelft.nl), Aleksandra Wilczynska, 4TU.ResearchData (a.e.wilczynska@tudelft.nl)

Abstract: Reproducibility remains a persistent challenge in computational research. Although journals increasingly require authors to share the software and data underlying their publications, making these materials available does not necessarily ensure that published results can be independently reproduced.

To support researchers in improving the reproducibility of their work, the TU Delft Digital Competence Center (DCC), in collaboration with 4TU.ResearchData, has launched the Reproducibility Check initiative. TU Delft researchers who deposit the software and data associated with their publications in 4TU.ResearchData repository are invited to participate in a reproducibility check. Using the CODECHECK process (Nüst and Eglen, 2021), research software and data engineers from the DCC attempt to reproduce the published results based on the shared materials and document the outcome of the process.

In this talk, we introduce the Reproducibility Check service and share experiences from the pilot phase, running since spring 2025. We discuss common challenges encountered in reproducing computational studies, approaches to engaging researchers, and lessons learned from implementing the service. We also reflect on opportunities to develop communities of practice around CODECHECK, in which researchers can contribute as codecheckers for the work of their peers.

Tutorial: Reproducibility Check

When: Monday, July 20 2026, 16:30-18:00

Where: ECHO Building

Author: João Guimarães (DCC)

Abstract: Following the “Presentation: A Reproducibility Check Service for Computational Research”, in this session we will show a demo on how we at the DCC conduct our reproducibility checks in collaboration with the 4TU.ResearchData repository.

First we will have a brief introduction to the CODECHECK workflow (Nüst and Eglen, 2021) we adopted in our Reproducibility Check service and the resulting CODECHECK certificate.

Then we will go through a demo showing how we put into practice the CODECHECK workflow by revisiting step by step a few of the reproducibility checks we completed in the past.

The materials of the demo are made available in this hackmd. Not required to bring your own laptop, but if participants prefer a more hands-on approach and try the reproducibility checks themselves they are welcome to do so.

Tutorial: FAIR & Public Knowledge Infrastructures for Reproducibility

When: Tuesday, July 21 2026, Part 1: 13:30-15:00, Part 2: 15:30-17:00

Where: ECHO Building

Authors: Vinodh Ilangovan and Markus Stocker (Leibniz Information Centre for Science and Technology and University Library (TIB))

Abstract: This hands-on tutorial introduces the Open Research Knowledge Graph (ORKG) and TIB Knowledge Loom as complementary tools for making research contributions structured, machine-actionable, and reproducible. Participants will learn how to transform unstructured publications into FAIR-compliant knowledge units, create structured comparisons, and integrate semantic objects into dynamic knowledge workflows. No prior experience with knowledge graphs is required.

Workshop: Tools for sustainable software

When: Wednesday, July 22 2026, 13:30-15:00

Where: ECHO Building

Author: Manuel Garcia Alvarez (DCC)

Abstract: In this workshop I will introduce a set of open-source tools developed by the DCC to enable reproducibility: Fairly, a tool for preparing, uploading and downloading datasets from popular research data repositories such as Zenodo, DataverseNL, and 4TU.ResearchData, Meta-Template, an idea and tool for aligning software best practices in research, and Code Auditor, a tool to audit code quality and compliance with best practices. In the workshop, participants will learn about best practices when developing research software using those tools. The workshop includes short presentations and discussions, live demos, hands-on exercises. A varied program that aims to inspire participants to become adopters of best practices that facilitate reproducibility and replicability in research.

What to bring: You will get best results by participating in hands-on exercises and applying them to your code and use cases. Therefore, bring a laptop with installation rights to the workshop, and prepare for the workshop by making sure you have Git and Python installed. However, you are also welcome to join if you only want to see the live demos and take part in the discussions.

ACM REP 2027

Attempt to rerun, reproduce and replicate Clinical Trials Sentence Classification Studies: lessons learnt

Experience with Reproducibility and Consistency in Writing an Academic Paper

LLMs in Citation Intent Classification: Progress, Precision, and Reproducibility Challenges

Posters

Toward a Systematic Assessment of Map Reproduction Success Using OCR

Sponsors

Travel & Venue

Featured Keynote Speakers

Agenda

Code of Conduct

Unacceptable behaviors include, but are not limited to:

Consequences of Unacceptable Behavior

How to Report Unacceptable Behavior

Diversity & Inclusion

Health & Safety

Housing

Hotels

Registration

Registration fees

Important Dates

Terms and Conditions

Authors

Students

Cancellation Policy

Tutorials, Presentations, and Workshops

Presentation: A Reproducibility Check Service for Computational Research

Tutorial: Reproducibility Check

Tutorial: FAIR & Public Knowledge Infrastructures for Reproducibility

Workshop: Tools for sustainable software