Active Computing & AI Society, Politics & Law

How can we create a more just society with A.I.?

In plain English

AI plain-English summary

Artificial intelligence systems are classifying people into categories—gender, risk, threat level—and getting it wrong for those who don't fit neat boxes. This project tackles a fundamental gap: current AI fairness research defines justice in narrow, technical terms (like equal accuracy across groups), but ignores how power and marginalisation shape what "justice" actually means for different communities. The researchers will build a conceptual model that maps different definitions of justice onto AI tasks, then test it through three case studies where minority interests are routinely overridden: non-binary people in sexism-detection algorithms, sex workers and artists unfairly deplatformed by content moderation, and activists shadow-banned under counter-terrorism AI. If successful, the work could produce practical guidelines for AI developers on how to handle trade-offs and errors when serving marginalised groups—shifting AI from a tool that compounds inequality to one that actively prioritises the most harmed. The project is primarily conceptual and methodological, not a deployed system, but its outputs (a design challenge for AI conferences, a set of guidelines) could reshape how the AI-for-social-good field defines its own success.

View original technical description
Justice can be viewed as "objective" or mediated through power [Chomsky & Foucault, 1971; Costanza-Chock, 2018]. Finding commonalities across different legal and ethical frameworks [Floridi & Cowls, 2019; Jobin et al., 2019] is an example of the former. In the latter, justice is a "requirement" for non-equitable societies, ensuring protection for the most harmed [Cugueró-Escofet & Fortin, 2014]. The difficulty in achieving this type of justice through A.I. is that A.I. is used primarily for classification and prediction [Vinuesa et al., 2020]. Growing evidence indicates that A.I. accelerates and compounds social bias, contributing to unequal distributions of power [O'Neil, 2016, p. 3, Noble, 2018; Benjamin]. "Trade-offs" in providing accurate and fair predictions also impact sub-populations disproportionately [Yu et al. 2020], meaning that people with multiple forms of marginalisation are more likely to be misunderstood by A.I. than those with normative characteristics [Costanza-Chock, 2018]. While there are legal and ethical frameworks that should govern the way we use A.I., minority voices are still under-represented [Buolamwini, J. and Gebru, T., 2018, Costanza-Chock, 2018; Magalhães & Couldry, 2020] and there are few structures for enforcement and accountability [Mittelstadt, 2019]. We need to rethink how A.I. is contributing to justice as a relational concept, which includes dimensions of power and marginalisation. My proposal draws together the cultural, technical, and socio-technical expertise necessary to extend our current notions of justice in empirical research for A.I. for social good (AI4SG). To start with, the core team will develop a conceptual model of A.I. and "justice" that includes a) different definitions of justice used to frame the tasks of A.I. and evaluate their efficacy, b) the questions that can be answered under that definition and c) the trade-offs that are determined to be acceptable in the process. The research team will map scholarly literature from AI4SG to the ethical, legal or political frameworks that underpin the research, identifying gaps or conflicts in how justice is operationalised within AI4SG in comparison with other social justice models. In particular, we will explore the questions: are different positions on justice incompatible with A.I.? Can we identify new pathways for justice to emerge? To extend our conceptual model, we will conduct 3 case studies in which minority interests are ignored within specific A.I. tasks: 1) non-binary people in gender-based analysis of sexism 2) discriminatory deplatforming of sex workers or artists through content moderation and 3) shadow-banning activists as part of a counter-terrorism approach. The case studies will explore conflicts between these communities' concept of justice and the A.I. task, and which alternative solutions exist. They will also contribute to the global problem of tackling online harm and using A.I. techniques to help identify and classify relevant cases. Finally, to test alternative solutions, a multi-sectoral Advisory Board of A.I. and community experts will be brought together to create a design challenge for A.I. researchers. Issued through 2 workshops at top-level A.I. conferences, the challenge will be to prioritise marginalised perspectives. The outputs of the challenge and their evaluation will inform a set of guidelines for dealing with errors and trade-offs in AI4SG. Our contribution is to a) expose connections between how A.I. researchers define justice and which justice questions we attend to in AI4SG; b) reflect on the benefits of A.I. for which societies; and c) influence and inspire researchers to question assumptions of A.I. research around acceptable trade-offs and errors. This research will bring together social scientists, community experts and A.I. researchers to explore what new lines of inquiry can be opened by focusing on maximising the benefits in A.I. for marginalised groups

View the original record at the funder ↗

Researchers

Tracie Farrell (Principal Investigator)

Related Research

Grants with similar aims, by meaning.

Sustainable AI Futures
The Ethics of Environmental AI: Modelling Public Perceptions
Unlocking the Potential of AI for English Law
Shared Post-Human Imagination: Human-AI Collaboration in Media Creation
Regulatory Frameworks for Responsible AI Innovation in a Corporate Setting: Bridging Ethical Governance and Technological Advancement

Original classification

Fellowship

Plain English summaries and category classifications on this site are generated by AI and may not perfectly reflect the original research.