Tutorials, Presentations, and Workshops

Presentation: A Reproducibility Check Service for Computational Research

When: Monday, July 20 2026, 15:45-16:30

Where: ECHO Building

Authors: Yasel Quintero, TU Delft (y.i.quinterolares@tudelft.nl), Joao Guimaraes, TU Delft (j.guimaraes@tudelft.nl), Aleksandra Wilczynska, 4TU.ResearchData (a.e.wilczynska@tudelft.nl)

Abstract: Reproducibility remains a persistent challenge in computational research. Although journals increasingly require authors to share the software and data underlying their publications, making these materials available does not necessarily ensure that published results can be independently reproduced.

To support researchers in improving the reproducibility of their work, the TU Delft Digital Competence Center (DCC), in collaboration with 4TU.ResearchData, has launched the Reproducibility Check initiative. TU Delft researchers who deposit the software and data associated with their publications in 4TU.ResearchData repository are invited to participate in a reproducibility check. Using the CODECHECK process (Nüst and Eglen, 2021), research software and data engineers from the DCC attempt to reproduce the published results based on the shared materials and document the outcome of the process.

In this talk, we introduce the Reproducibility Check service and share experiences from the pilot phase, running since spring 2025. We discuss common challenges encountered in reproducing computational studies, approaches to engaging researchers, and lessons learned from implementing the service. We also reflect on opportunities to develop communities of practice around CODECHECK, in which researchers can contribute as codecheckers for the work of their peers.

Tutorial: Reproducibility Check

When: Monday, July 20 2026, 16:30-18:00

Where: ECHO Building

Author: João Guimarães (DCC)

Abstract: Following the “Presentation: A Reproducibility Check Service for Computational Research”, in this session we will show a demo on how we at the DCC conduct our reproducibility checks in collaboration with the 4TU.ResearchData repository.

First we will have a brief introduction to the CODECHECK workflow (Nüst and Eglen, 2021) we adopted in our Reproducibility Check service and the resulting CODECHECK certificate.

Then we will go through a demo showing how we put into practice the CODECHECK workflow by revisiting step by step a few of the reproducibility checks we completed in the past.

The materials of the demo are made available in this hackmd. Not required to bring your own laptop, but if participants prefer a more hands-on approach and try the reproducibility checks themselves they are welcome to do so.

Tutorial: FAIR & Public Knowledge Infrastructures for Reproducibility

When: Tuesday, July 21 2026, Part 1: 13:30-15:00, Part 2: 15:30-17:00

Where: ECHO Building

Authors: Vinodh Ilangovan and Markus Stocker (Leibniz Information Centre for Science and Technology and University Library (TIB))

Abstract: This hands-on tutorial introduces the Open Research Knowledge Graph (ORKG) and TIB Knowledge Loom as complementary tools for making research contributions structured, machine-actionable, and reproducible. Participants will learn how to transform unstructured publications into FAIR-compliant knowledge units, create structured comparisons, and integrate semantic objects into dynamic knowledge workflows. No prior experience with knowledge graphs is required.

Workshop: Tools for sustainable software

When: Wednesday, July 22 2026, 13:30-15:00

Where: ECHO Building

Author: Manuel Garcia Alvarez (DCC)

Abstract: In this workshop I will introduce a set of open-source tools developed by the DCC to enable reproducibility: Fairly, a tool for preparing, uploading and downloading datasets from popular research data repositories such as Zenodo, DataverseNL, and 4TU.ResearchData, Meta-Template, an idea and tool for aligning software best practices in research, and Code Auditor, a tool to audit code quality and compliance with best practices. In the workshop, participants will learn about best practices when developing research software using those tools. The workshop includes short presentations and discussions, live demos, hands-on exercises. A varied program that aims to inspire participants to become adopters of best practices that facilitate reproducibility and replicability in research.

What to bring: You will get best results by participating in hands-on exercises and applying them to your code and use cases. Therefore, bring a laptop with installation rights to the workshop, and prepare for the workshop by making sure you have Git and Python installed. However, you are also welcome to join if you only want to see the live demos and take part in the discussions.