AI Peer: Large language models and academic peer review outcomes

  • Status: Avsluttet
  • Start: 01.03.2025
  • Slutt: 31.08.2026

Prosjektbeskrivelse

Mission: To investigate the extent to which large language models and other artificial intelligence methods can support peer and expert review of academic documents. This includes developing and evaluating algorithms and strategies.

Goal 1: Using and assessing LLMs for AI peer/expert review

Develop and evaluate the ability of Large Language Models to predict the peer review quality scores that human experts would give to published academic research.

Goal 2: Promote a discussion about responsible and ethical uses of AI in peer/expert evaluation of academic research.

Grant number: ESRC APP43146

https://sites.google.com/sheffield.ac.uk/peer-ai/home

 

Resultater

År Tittel Type Forfattere
2025 LLM’s and Human’s Reviews of Journal Articles Konferanseforedrag Liv Langfeldt
2025 Anbefaler ikke å bruke språk­modeller til å vurdere forskning Intervju Liv Langfeldt
2026 How (not) to use Large Language Models to assess research Foredrag Liv Langfeldt
2026 How (not) to use Large Language Models to assess research Innsikt Liv Langfeldt, Mike Thelwall, Dag W. Aksnes

Deltagere

bilde av Mike Thelwall
Prosjektleder

Mike Thelwall

Liv Langfeldt

Forsker 1

Dag W. Aksnes

Forsker 1

Henrik Karlstrøm

Forsker 1