BELIV 2024 Papers
Session 1: Welcome, Keynote and Q&A, and Paper Talks
(8:30am - 9:45am
EST)
8:30 - 8:40: Welcome Opening Dr. Simone Stumpf — How to Empower Stakeholders to Assess AI systems
Assessing AI to make sure it is ethical and responsible has, until now, been left solely in the hands of AI experts. There is no agreement of what counts as ‘good enough’ to be acceptable to stakeholders, including ones who ultimately use the AI or are affected by its outputs. PHAWM, one of three RAI UK-funded keystone projects, is driving change in AI testing and evaluation through the novel concept of participatory AI auditing, where a diverse set of stakeholders without a technical background in AI, such as domain experts, regulators, decision subjects and end-users, are empowered to undertake audits of predictive and generative AI, either individually or collectively. This talk will describe the landscape of AI assessment, particularly from a stakeholder perspective. [More Info]
Judith Friedl-Knirsch
Mai Elshehaly, Mirela Reljan-Delaney, Jason Dykes, Aidan Slingsby, Jo Wood, Sam Spiegel
BREAK 9:45 - 10:15
Session 2: Experiments and Evaluations (Paper Presentations) + Break-out Session (10:15am - 11:30am EST)
10:15 - 10:20: Session Intro
Anamaria Crisan, Nathan Butters, Zoe
Sheng Long, Matthew Kay
Abhraneel Sarma, Sheng Long, Michael Correll, Matthew Kay
Kiran Smelser, Jacob Miller, Stephen Kobourov
BREAK 11:30-12:00
Session 3: Theory and Practice (Paper Presentations) (12:00pm - 1:15pm EST)
12:00 - 12:05: Session Intro
Antonia Schlieder, Jan Rummel, Peter Albers, Filip Sadlo
Matthew Berger, Shusen Liu
Eugene Wu, Remco Chang
Florian Windhager, Alfie Abdul-Rahman, Mark-Jan Bludau, Nicole Hengesbach, Houda Lamqaddam, Isabel Meirelles, Bettina Speckmann, Michael Correll
Jasmine Tan Otto, Scott Davidoff
Lonni Besançon, Brian Nosek, Tamarinde Haven, Miriah Meyer, Cody Dunne, Mohammad Ghoniem
Tobias Isenberg
BREAK 1:15 - 1:45pm
Session 4: Reflections and Research Directions (Paper Presentations) + Break-out Session (1:45pm - 3:00pm EST)
1:45 - 1:50: Session Intro
Seyda Öney, Moataz Abdelaal, Kuno Kurzhals, Paul Betz, Cordula Kropp, Daniel Weiskopf
Anamaria Crisan
Daniel Weiskopf
Feng Lin, Arran Zeyu Wang, Md Dilshadur Rahman, Danielle Albers Szafir, Ghulam Jilani Quadri