NIHR grant committee members routinely favour male principal investigators over women, racial minorities, and early-career researchers, even when the science is equally strong. This project tackles a specific gap: no established method exists for deciding how much weight to give equality, diversity, and inclusion (EDI) factors relative to traditional academic criteria when scoring grant applications. Funders face trade-offs when applications have different strengths and weaknesses, and some—like the British Academy—are now testing modified lotteries to improve grantee diversity. The researchers will run a discrete choice experiment with NIHR panel members to quantify exactly how reviewers trade off applicant characteristics against peer review scores. If successful, the work will produce empirically derived weights that funders can plug directly into both conventional scoring systems and weighted lottery mechanisms. This could make research funding allocation more transparent and systematic, reducing the unconscious biases that currently skew awards toward established, male-led teams. The findings will be translated into policy through workshops with the NIHR and other funding agencies, with results published in peer-reviewed journals.
View original technical description
Context: Research funders face various criteria when allocating funding, increasingly emphasizing equality, diversity, and inclusion (EDI) alongside traditional measures of research excellence. The NIHR's Equality, Diversity, and Inclusion Strategy 2022-27 aims to fund more inclusive research conducted by diverse teams, reflecting similar objectives of many UK and international funders, including the NIH and NHMRC. These initiatives aim to address shortcomings in existing processes that lead to imbalances in research funding allocation, such as the disproportionate awarding of grants to male principal investigators and barriers faced by women, racial minorities, and early career researchers. The Topic the Project Addresses: The project addresses the lack of established processes for determining the relative weights of EDI factors compared to traditional academic criteria in grant assessment and allocation. Traditional approaches involve scoring research applications against predefined criteria, but funders face trade-offs when applications have different strengths and weaknesses. Some funders, like the British Academy, are experimenting with modified lotteries to improve grantee diversity. This project explores innovative approaches to how EDI criteria may incorporated into both traditional funding mechanisms and weighted lotteries, to enhance equity and diversity in research funding. Aims and Objectives: The project aims to understand the decision-making process of NIHR grants committees, the trade-offs they make in allocating funding, and their preferences for particular applicant characteristics. It also aims to explore the possibility of incorporating these preferences into a more transparent and systematic allocation mechanism. Specific objectives include: Quantifying preferences for observable characteristics of applicants and adjustments for EDI. Understanding how these factors interact with the applicant’s peer review score. Exploring how empirically derived weights could be incorporated into future funding decisions. Simulating the impact of EDI weights on research funding allocation using traditional methods and modified lottery mechanisms. Translating research findings into policy and communicating them to the research community. Potential Applications and Benefits: This project will involve conducting a discrete choice experiment (DCE) to estimate the preferences of NIHR panel members and reviewers for different assessment criteria. The DCE will quantify preferences for different applicant characteristics and adjustments for EDI, helping to understand how these factors interact with the applicant’s score. The results will provide insights into how participants trade off different applicant characteristics when prioritizing funding applications. The project will explore how these empirically derived weights could be incorporated into future funding decisions. This includes simulating the impact of EDI weights on research funding allocation through traditional methods and incorporating weights into a modified lottery mechanism. The project will be implemented within a structured program of research and translation, in collaboration with the NIHR and other funding agencies. The implementation will involve setting up a steering committee with members of the research team and key academics involved in the NIHR. Two virtual workshops will be held: one early in the project to inform the design of the DCE and another to disseminate results and explore how findings can be incorporated into NIHR funding processes. The results will be published in peer-reviewed journals and promoted through media channels. Towards the end of the project, two translation workshops will be conducted to provide an overview of the study results and explore how different types of weighting might be incorporated in future funding processes to achieve greater equity, diversity, and inclusion in research funding allocation.
Adrian Barnett (Co-Investigator)Mara Violato (Co-Investigator)Marian Knight (Co-Investigator)Philip Clarke (Principal Investigator)Ray Duch (Co-Investigator)Rhys Thomas (Co-Investigator)
Plain English summaries and category classifications on this site are generated by AI and may not perfectly reflect the original research.
Is something wrong? Let us know