Third European Workshop on Algorithmic Fairness (EWAF'24)

1 Jul 2024, 08:00 → 3 Jul 2024, 18:00 Europe/Berlin

Alte Mensa (Mainz)

Timetable App

A 3-day interdisciplinary workshop bringing together researchers in algorithmic fairness

With the ever-expanding influence of AI, the conversation around algorithmic fairness has become a cornerstone of responsible technology development. The Third European Workshop on Algorithmic Fairness intends to advance this discourse with a unique focus on the European experience.

The broad concept of EWAF is to showcase the proactive efforts and innovative research emerging from Europe, emphasizing its potential to guide global standards. The workshop welcomes interdisciplinary submissions dealing with the fields of computer science, law, sociology and philosophy and especially submissions which deal with issues of European specificity.

The workshop will be held from July the 1st to July the 3rd at the Alte Mensa of Johannes Gutenberg-Universität in Mainz, Germany.

Pre-Proceedings

Monday, 1 July

08:00 → 09:00 Registration / Badge Pickup

08:00 Registration / Badge Pickup

09:00 → 09:30 Welcome Address

09:30 → 10:30 Keynote Talk: Prof. Bettina Berendt, TU Berlin, Weizenbaum Institute, and KU Leuven

De-biased, diverse, divisive - On ethical perspectives regarding the de-biasing of GenAI and their actionability
AI tech companies cannot seem to get it right. After years of evidence-based criticism of biases in AI, in particular decision models, LLMs and other generative AI, after years of research and toolbox provision for de-biasing, many companies have implemented such safeguards into their services. However, ridicule and protests have recently erupted when users discovered generated images that were “(overly?) diversified” with respect to gender and ethnicity and answers to ethical questions that were “(overly?) balanced” with regard to moral stances. Is this seeming contradiction just a backlash, or does it point to deeper issues? In this talk, I will analyse instances of recent discourse on too little or too much “diversification” of (Gen)AI and relate this to methodological criticism of “de-biasing”. A second aim is to contribute to the broadening and deepening of answers that computer science and engineering can and should give to enhance fairness and justice.

10:30 → 11:00 Coffee & Posters

11:00 → 12:00 Lightning Round 1

11:00 Algorithmic Fairness Over Time: Advances & Prospects

Speaker: Miriam Rateike

11:05 Can generative AI-based data balancing mitigate unfairness issues in Machine Learning?

Speakers: Benoît Ronval, Ludwig Bothmann, Siegfried Nijssen

11:10 Governing online platforms after the Digital Services Act: an analysis of the Commission decision on initiating proceedings against X

Speaker: Matteo Fabbri

11:15 Algorithmic Fairness in Geo-intelligence Workflows through Causality

Speakers: Brian Masinde, Caroline Gevaert, Jaap Zevenbergen, Marc van den Homberg, Michael Nagenborg

11:20 Threshold Recourse for Dynamic Allocations

Speakers: Anne-Marie George, Christos Dimitrakakis, Meirav Segal

11:25 Categorizing algorithmic recommendations: a matter of system, agent, patient

Speakers: Jesus Salgado, Matteo Fabbri

11:30 Exploring Fusion Techniques in Multimodal AI-Based Recruitment: Insights from FairCVdb

Speakers: Arjun Roy, Eirini Ntoutsi, Swati Swati

11:35 Social Assessment and Cultural Resistance: The Public Distribution System in Tamil Nadu, India

Speaker: Sumathi Rajesh

12:00 → 13:00 Lunch

13:00 → 14:00 Keynote Talk: Prof. Dr. Virginia Dignum, Umeå University

Beyond the AI hype: Balancing Innovation and Social Responsibility
AI can extend human capabilities but requires addressing challenges in education, jobs, and biases. Taking a responsible approach involves understanding AI's nature, design choices, societal role, and ethical considerations. Recent AI developments, including foundational models, transformer models, generative models, and large language models (LLMs), raise questions about whether they are changing the paradigm of AI, and about the responsibility of those that are developing and deploying AI systems. In all these developments, is vital to understand that AI is not an autonomous entity but rather dependent on human responsibility and decision-making.
In this talk, I will further discuss the need for a responsible approach to AI that emphasize trust, cooperation, and the common good. Taking responsibility involves regulation, governance, and awareness. Ethics and dilemmas are ongoing considerations, but require understanding that trade-offs must be made and that decision processes are always contextual. Taking responsibility requires designing AI systems with values in mind, implementing regulations, governance, monitoring, agreements, and norms. Rather than viewing regulation as a constraint, it should be seen as a stepping stone for innovation, ensuring public acceptance, driving transformation, and promoting business differentiation. Responsible Artificial Intelligence (AI) is not an option but the only possible way to go forward in AI.

Virginia Dignum is Professor of Responsible Artificial Intelligence at Umeå University, Sweden where she leads the AI Policy Lab. She is also senior advisor on AI policy to the Wallenberg Foundations. She has a PHD in Artificial Intelligence from Utrecht University in 2004, is member of the Royal Swedish Academy of Engineering Sciences (IVA), and Fellow of the European Artificial Intelligence Association (EURAI). She is a member of the United Nations Advisory Body on AI, the Global Partnership on AI (GPAI), UNESCO’s expert group on the implementation of AI recommendations, OECD’s Expert group on AI, founder of ALLAI, the Dutch AI Alliance, and co-chair of the WEF’s Global Future Council on AI. She was a member of EU’s High Level Expert Group on Artificial Intelligence and leader of UNICEF's guidance for AI and children. Her new book “The AI Paradox” is planned for publication in late 2024.

14:00 → 14:30 Coffee & Posters

14:30 → 15:30 Lightning Round 2

14:30 Implications of the AI Act for Non-Discrimination Law and Algorithmic Fairness

Speakers: Conradin Braun, Domenique Zipperling, Jan-Laurin Müller, Kühl Niklas, Luca Deck

14:35 Policy Advice and Best Practices on Bias and Fairness in Artificial Intelligence

Speakers: Alaa Elobaid, Alejandra Bringas-Colmenarejo, Antonio Ferrara, Carlos Mougan, Ioanna Papageorgiou, Jose M. Alvarez, Kristen Scott, Laura State, Miriam Fahimi, Paula Reyero, Russo Mayra, Salvatore Ruggieri, Siamak Ghodsi, Simone Fabrizzi, Xuan Zhao

14:40 Watching the Watchers: A Comparative Fairness Audit of Cloud-based Content Moderation Services

Speakers: Amin Oueslati, David Hartmann, Dimitri Staufer

14:45 Enhancing Fairness through Time-Aware Recourse: A Pathway to Realistic Algorithmic Recommendations

Speakers: Isabel Valera, Isacco Beretta, Martina Cinquini

14:50 Beyond Silos: An Interdisciplinary Analysis of Intersectional Discrimination from an EU Perspective

Speaker: Stephan Wolters

14:55 Eliciting Discrimination Risks in Algorithmic Systems: Taxonomies and Recommendations

Speaker: Marta Marchiori Manerba

15:00 Risky Complaints: Unpacking Recent Trends in Risk Assessment Across Global Supply Chains

Speaker: Gabriel Grill

15:05 Risk Scores as Statistical Fatalism

Speakers: Konstantin Genin, Sebastian Zezulka

15:10 On Prediction-Modelers and Decision-Makers: Why Fairness Requires More Than a Fair Prediction Model

Speakers: Christoph Heitz, Joachim Baumann, Teresa Scantamburlo

15:30 → 16:30 Coffee & Posters

16:30 → 17:30 In-Depth Session 1a

16:30 Mapping Policymakers' and Laypeople's Perceptions of genAI and FPT in the Context of the EU AI Act

Speakers: Chiara Ullstein, Jens Grossklags, Michel Hohendanner

17:00 Fair Balancing? Evaluating LLM-based Privacy Policy Ethics Assessments

Speakers: Erik Buchmann, Vincent Freiberger

16:30 → 17:30 In-Depth Session 1b

16:30 Unfairness in AI Anti-Corruption Tools: Main Drivers and Consequences

Speaker: Fernanda Odilla

16:50 Mapping the Potential of Explainable Artificial Intelligence (XAI) for Fairness Along the AI Lifecycle

Speakers: Astrid Schoemäcker, Jakob Schöffer, Lena Kästner, Luca Deck, Niklas Kühl, Timo Speith

17:30 → 18:30 Poster Session

Papers from Lightning Rounds 1&2, Papers from In-Depth Session 1
Various Authors

19:00 → 00:00 Social Event 1

Salon 3SEIN
Große Bleiche 60-62, 55116 Mainz
https://maps.app.goo.gl/6woSXPSg1rfNRXTPA

Tuesday, 2 July

08:00 → 09:30 Registration / Badge Pickup

09:30 → 10:30 Keynote Talk: Prof. Seth Lazar, Australian National University (online)

10:30 → 11:00 Coffee & Posters

11:00 → 12:00 Lightning Round 3

11:00 A Fair Selective Classifier to Put Humans in the Loop

Speakers: Andrea Pugnana, Daphne Lenders, Dino Pedreschi, Fosca Giannotti, Roberto Pellungrini, Toon Calders

11:05 Fairness Beyond Binary Decisions: A Case Study on German Credit

Speakers: Deborah Dormah Kanubala, Isabel Valera, Kavya Gupta

11:10 Challenging "Subgroup Fairness": Towards Intersectional Algorithmic Fairness Based on Personas

Speakers: Carmen Leicht-Scholten, Laila Wegner, Marie Decker

11:15 Deciding the Future of Refugees: Rolling the Dice or Algorithmic Location Assignment?

Speakers: Christoph Kern, Clara Strasser Ceballos

11:20 How to be fair? A discussion and future perspectives

Speakers: Marco Favier, Toon Calders

11:25 Enabling users’ control on recommender systems for short videos: a design proposal for the implementation of the requirements of the Digital Services Act

Speakers: Jingyi Jia, Matteo Fabbri, Wolfgang Woerndl

11:30 Algorithmic Fairness in Clinical Natural Language Processing: Challenges and Opportunities

Speakers: Anastasia Giachanou, Daniel Anadria, Daniel Oberski, Jacqueline Kernahan, Roel Dobbe

11:35 Trust in Fair Algorithms: Pilot Experiment

Speakers: Alesia Vallenas Coronel, Kiara Stempel, Marius Köppel, Mattia Cerrato, Niklas Witzig

11:40 Identifying Gender Stereotypes and Biases in Automated Translation from English to Italian using Similarity Networks

Speakers: Costanza Nardocci, Fatemeh Mohammadi, Marta Anamaria Tamborini, Paolo Ceravolo, Samira Maghool

12:00 → 13:00 Lunch

13:00 → 14:30 Interactive Session 1a

Building Bridges from and Beyond the EU Artificial Intelligence Act. Regulating AI-based Discrimination in the European Scenario
Marilisa D'Amico, Ernesto Damiani, Costanza Nardocci, Paolo Ceravolo, Samira Maghool, Marta Annamaria Tamborini, Paolo Gambatesa and Fatemeh Mohammadi

Abstract:
The panel aims to discuss the implications following the approval of the EU Artificial Intelligence Act also in light of the additional initiatives ongoing in the European and global scenario (e.g. Council of Europe, UNESCO, United Nations) from the perspective of their adequacy to ensure the fairness of algorithms and to tackle discriminations resulting from the massive resort to AI technologies. By bringing together constitutional law and computer science expertise, the discussion has a twofold aim. On the one hand, the panel aims to illustrate the criticisms that underlie the risks of AI systems from a constitutional and human rights perspective, supported by the analysis of computer science; on the other hand, it aims to explore innovative strategies to promote an inclusive use of AI technologies by designers and implementers in order to enhance their positive potential.

13:00 Building Bridges from and Beyond the EU Artificial Intelligence Act. Regulating AI-based Discrimination in the European Scenario

Speakers: Costanza Nardocci, Ernesto Damiani, Fatemeh Mohammadi, Marilisa D'Amico, Marta Annamaria Tamborini, Paolo Ceravolo, Paolo Gambatesa, Samira Maghool

13:00 → 14:30 Interactive Session 1b

Moral Exercises for Human Oversight of AI Systems
Teresa Scantamburlo and Silvia Crafa

Abstract:
The interactive session addresses the challenge of ethical reflection in AI research and practice. Human judgement is crucial in balancing accuracy and fairness trade-offs and overseeing AI system behaviour. To support ethical reflection and judgement we propose the experience of moral exercises: structured activities aimed at engaging AI actors in realistic ethical problems involving the development or use of an AI system. Participants undergo guided exercises involving scenario analysis, individual and group work, highlighting consensus and divergences on the problem at stake. The initiative will promote the development of moral exercises and help refine the methodology for AI ethics education.

13:00 Moral Exercises for Human Oversight of AI Systems

Speakers: Silvia Crafa, Teresa Scantamburlo

14:30 → 15:30 Coffee & Posters

15:30 → 17:00 Interactive Session 2a

How the Digital Services Act can enable researcher access to data of the largest online platforms and search engines - interactive session with the European Commission
EC Joint Research Centre

The Digital Services Act (DSA) entered into full force in February, and aims to create a safer and more trustworthy digital space, where the fundamental rights of all users are protected. As part of the DSA’s transparency obligations, Article 40 of the DSA establishes the obligation of Very
Large Online Platforms (VLOPs) and Very Large Online Search Engines (VLOSEs) to provide researchers with access to data for the purposes of conducting research that
contributes to the detection, understanding and mitigation of systemic risks in the European Union, such as discrimination and the spread of disinformation.
In particular, Article 40(12) of the DSA obliges providers of VLOPs and VLOSEs to give researchers access to data that is publicly available in their interfaces. In addition, Article 40(4) of the DSA establishes a data access mechanism through which researchers who undergo a vetting procedure can obtain access to non-public data for the study of systemic risks in the European Union.
In this workshop, the Commission will present the data access mechanism for vetted researchers and participants will have the opportunity to provide feedback on a detailed proposal for its procedural, technical and operational elements, which is currently being prepared in the form of a delegated act. Participants will get the chance to explore how data access could benefit their research, which challenges they foresee and how these may be overcome. Participants will also hear about how the DSA protects researcher access to publicly available data, and will be able to provide feedback on the data access tools and procedures made available by VLOPs and VLOSEs to this end so far.

15:30 How the Digital Services Act can enable researcher access to data of the largest online platforms and search engines - interactive session with the European Commission EC Joint Research Centre

15:30 → 17:00 Interactive Session 2b

Fairness, or not Fairness, That is the Question. Rethinking Virtual Assistants' Responses From an Ethical Perspective
Giulia Teverini, Joy Ciliani and Alessia Nicoletta Marino

Abstract: The workshop aims to delve into the intricate aspects of ethics applied to human-computer interaction. Participants will engage in practical activities in which they will analyze conversations with virtual assistants, distinguishing between appropriate and inappropriate interactions. In this context, the ethical principles proposed by the European Commission will be used as guidelines to ensure favorable conditions for the development of trustworthy AI-based systems. Immediately after participants will be asked to propose scenario-based solutions to tackle ethical issues which have emerged in the previous stage. At the end of the workshop, each group will show the result to the audience. The collaborative nature of the workshop aims at fostering critical thinking, practical understanding, and collective reasoning.

15:30 Fairness, or not Fairness, That is the Question. Rethinking Virtual Assistants' Responses From an Ethical Perspective

Speakers: Alessia Nicoletta Marino, Giulia Teverini, Joy Ciliani

17:00 → 18:00 Poster Session 2

Papers from Lightning Round 3
Various Authors

19:00 → 00:00 Social Event 2

Schlossbiergarten
Peter-Altmeier-Allee 1, 55116 Mainz
https://maps.app.goo.gl/bRui4ticSuAM1urh7

Wednesday, 3 July

08:00 → 09:00 Registration / Badge Pickup

09:00 → 10:00 Keynote Talk: Prof. Isabel Valera, University of Saarland

"Society-centered AI: An Integrative Perspective on Algorithmic Fairness"
Abstract: In this talk, I will share my never-ending learning journey on algorithmic fairness. I will give an overview of fairness in algorithmic decision making, reviewing the progress and wrong assumptions made along the way, which have led to new and fascinating research questions. Most of these questions remain open to this day, and become even more challenging in the era of generative AI. Thus, this talk will provide only few answers but many open challenges to motivate the need for a paradigm shift from owner-centered to society-centered AI. With society-centered AI, I aim to bring the values, goals, and needs of all relevant stakeholders into AI development as first-class citizens to ensure that these new technologies are at the service of society.

10:00 → 10:30 Coffee break

10:30 → 12:00 Interactive Session 3b

Striving for Equity: Navigating Algorithmic Fairness for AI in the Workplace
Thea Radüntz, Martin Brenzke and Dominik Köhler

10:30 Striving for Equity: Navigating Algorithmic Fairness for AI in the Workplace

Speakers: Dominik Köhler, Martin Brenzke, Thea Radüntz

10:30 → 12:00 Interactive session 3a

Artificial Intelligence for Assessment in the Context of Asylum Procedures – Lessons Learned and Reflections Upon Fairness-Related Challenges via Participatory Methods and Science-Policy Dialogue
AI-FORA

10:30 Artificial Intelligence for Assessment in the Context of Asylum Procedures – Lessons Learned and Reflections Upon Fairness-Related Challenges via Participatory Methods and Science-Policy Dialogue AI-FORA

12:00 → 13:00 Lunch

13:00 → 14:15 Lightning Round 4

13:00 Building job seekers’ profiles: can LLM’s level the playing field?

Speakers: Leid Zejnilovic, Susana Lavado

13:05 FAIRRET: A flexible PyTorch library for fairness

Speakers: Maarten Buyl, Marybeth Defrance, Tijl De Bie

13:10 Unveiling the Blindspots: Examining Availability and Usage of Protected Attributes in Fairness Datasets

Speakers: Alessandro Fabris, Christoph Kern, Jan Simson

13:15 Beyond Distributions: A Systematic Review on Relational Algorithmic Justice

Speakers: Carmen Leicht-Scholten, Laila Wegner, Marie Decker

13:20 Pricing Risk: Analysis of Irish Car Insurance Premiums

Speaker: Adrian Byrne

13:25 20% Increase in Fairness for Black Applicants: A Critical Examination of Fairness Measurements Offered by Startups

Speakers: Corinna Hertweck, Maya Guido

13:30 Integrating Fairness in AI Development: Technical Insights from the fAIr by design Framework

Speakers: Mira Reisinger, Rania Wazir

13:35 Algorithmic Collective Action in Recommender Systems: Promoting Songs by Reordering Playlists

Speakers: Celestine Mendler-Dünner, Joachim Baumann

13:40 Fairness in Graph-Theoretical Optimization Problems

Speakers: Christopher Hojny, Frits Spieksma, Sten Wessel

13:45 It is not about Bias but Discrimination

Speakers: Chaewon Yun, Claudia Wagner, Jan-Christoph Heilinger

13:50 Exploration of potential new benchmark for fairness evaluation in Europe

Speakers: Axel Legay, Lisa Koutsoviti Koumeri, Magali Legast, Yasaman Yousefi

14:15 → 15:00 Coffee & Posters

15:00 → 16:00 In-Depth Session 2a

15:00 Measurement Modeling of Predictors and Outcomes in Algorithmic Fairness

Speakers: Christoph Kern, Elisabeth Kraus

15:30 Proxy Fairness under the GDPR and the AI Act: A Perspective of Sensitivity and Necessity

Speaker: Ioanna Papageorgiou

15:00 → 16:00 In-Depth Session 2b

15:00 Inherent Limitations of AI Fairness

Speakers: Maarten Buyl, Tijl De Bie

15:30 When the Ideal Does Not Compute: Nonideal Theory and Fairness in Machine Learning

Speaker: Otto Sahlgren

16:00 → 17:00 Poster Session 3

Papers from Lightning Round 4, Papers from In-Depth Session 2
Various Authors

17:00 → 18:00 Closing