What the REF?!

HiddenREF

Welcome What the REF - Our attempt at demystifying everyone's favourite national research assessment exercise! Hosted on Acast. See acast.com/privacy for more information.

  1. What the REF do we do without Rebecca?!

    FEB 18

    What the REF do we do without Rebecca?!

    Research culture, open access battles, and major REF leadership news — this episode of What the REF?! unpacks the forces reshaping UK academia. The team reflects on the resignation of REF 2029 director Rebecca Fairbairn, debates universities walking away from big publishing deals, and explores how journal prestige still drives pressure and toxic incentives in some disciplines. They also let producer Ben on camera for once to introduce the new Hidden REF expert groups, which are a way of getting YOU involved in shaping the assessment criteria for not-traditionally submitted research outputs. Finally, they mark International Women and Girls in Science Day. Expect candid discussion on publishing power, research assessment, and how culture change in universities might actually happen. Interested in joining an expert group? You can sign up here: https://hidden-ref.org/expert-groups/ Our hosts are all members of the Hidden REF committee based at the universities of Southampton and Bristol: Gemma Derrick - a self-confessed REF junkie - James Baker and Ola Thomson, and our producer is Ben Thomas. Find out more about the HiddenREF campaign at Hidden-REF.org 'What the REF' is made possible by the Embedding Trust in Evaluation (E-TIE) research grant from Research England. Want to get in touch? Email: WTreF@hidden-ref.org WTreF is co-produced by Simon Hettrick, Gemma Derrick, James Baker and Ben Thomas. Video and Sound production by Ben Thomas. Hosted on Acast. See acast.com/privacy for more information.

    40 min
  2. What the REF is needed to assess research outputs fairly?!

    JAN 21

    What the REF is needed to assess research outputs fairly?!

    A new year of ‘REF-iness’ kicks off as the What the REF team unpack the fallout from December’s REF changes and look ahead to what 2026 holds. With the dust now settling, the conversation turns from reaction to reckoning: what do the new rules actually mean in practice, and who stands to gain or lose? The team highlight two must-read reflections on the reforms, including analysis of the removal of ‘culture’ from the former PCE and the disproportionate impact this may have on early career researchers, who often rely on less easily measurable contributions. While opinions differ on whether the shift from ‘culture’ to ‘strategy’ is substantive or merely semantic, there is consensus on one thing: the rules are set, and it is time to get on with it. Much of the episode focuses on findings from the Hidden REF’s recent ‘think-aloud’ experiment, where evaluators assessed non-traditionally submitted outputs (NTOs) in real time. Drawing on 68 detailed observations across outputs ranging from software and databases to music composition, the team explore how assessors actually operationalise significance, originality, and rigour when familiar academic heuristics fall away. The results expose recurring challenges: inconsistent 300-word descriptions, reliance on inappropriate proxies from traditional publishing, and the subtle creep of aesthetics and personal taste into judgement. The discussion moves from diagnosis to action. The team outline plans to translate these findings into practical assessment guidelines, to be tested and refined through workshops and the next Hidden REF competition. With submissions opening in March and an awards ceremony planned for November, the competition is positioned as both a low-risk testing ground and a rare source of joy in an otherwise anxiety-ridden REF cycle. The episode closes with a shared ambition: to shift non-traditional outputs from the margins to the mainstream through evidence, dialogue, and sustained collective effort. Our hosts are all members of the Hidden REF committee based at the universities of Southampton and Bristol: Gemma Derrick - a self-confessed REF junkie - Simon Hettrick and Ola Thomson, and our producer is Ben Thomas. Find out more about the HiddenREF campaign at Hidden-REF.org 'What the REF' is made possible by the Embedding Trust in Evaluation (E-TIE) research grant from Research England. Want to get in touch? Email: WTreF@hidden-ref.org WTreF is co-produced by Simon Hettrick, Gemma Derrick, James Baker and Ben Thomas. Video and Sound production by Ben Thomas. Hosted on Acast. See acast.com/privacy for more information.

    38 min
  3. What the REF do HR have to do with the REF?!

    12/23/2025

    What the REF do HR have to do with the REF?!

    This week on What the REF?!, Ola and James start to unpack the long-awaited REF announcement from December, sharing first reactions and a palpable sense of relief across the sector. While a full deep dive is parked until the new year, the episode offers an initial digest of what has landed, why certainty matters, and which debates are already bubbling up around outputs, narratives and research culture. The real highlight, though, is a fascinating interview with Sophie Crouchman from Universities Human Resources (UHR), conducted by Simon. Sophie lifts the lid on the often unseen role of HR in REF preparation and delivery, from staff data and equality impact assessments to promotion criteria, reward structures and institutional culture. She makes a compelling case that, despite the technical language and frameworks, REF is ultimately about people, and HR colleagues are central to making it work. The conversation explores workload, recognition, collaboration across professional services, and how HR teams support universities through constant policy change and uncertainty. It is a warm, insightful reminder that REF is a collective effort, powered by many roles that rarely get the spotlight. A cheerful, thought-provoking episode that celebrates the hidden work behind the headlines and sets the scene nicely for REF conversations in the year ahead. Our hosts are all members of the Hidden REF committee based at the universities of Southampton and Bristol: Gemma Derrick - a self-confessed REF junkie - Simon Hettrick and Ola Thomson, and our producer is Ben Thomas. Find out more about the HiddenREF campaign at Hidden-REF.org 'What the REF' is made possible by the Embedding Trust in Evaluation (E-TIE) research grant from Research England. Want to get in touch? Email: WTreF@hidden-ref.org WTreF is co-produced by Simon Hettrick, Gemma Derrick, James Baker and Ben Thomas. Video and Sound production by Ben Thomas. Hosted on Acast. See acast.com/privacy for more information.

    45 min
  4. What the REF do people want to know?!

    11/26/2025

    What the REF do people want to know?!

    In this lively episode of What the Ref, Gemma, James and Simon guide listeners through the endlessly surprising world of the Research Excellence Framework. Proceedings begin with Simon recounting the final NTO workshop of the year, held at the University of Exeter, which has become the national home of hyper-efficient scrutiny. The team is now preparing an expanded workshop programme for next year. From there, the conversation takes a dramatic turn. Mere minutes before recording, news dropped that the REF pause will end on 10 December, accompanied by major presentations from Dame Jessica Corner and the REF team. Cue excitement, mild panic, and the realisation that the next few weeks may involve emergency podcast episodes. Simon and Ola will be attending the Universities UK conference in person, and providing near-live commentary, possibly including gasps or cheers. The trio reflect on the sector’s peculiar ‘pause that was not a pause’. Although REF planning was officially frozen, universities have continued diligently preparing outputs, impacts and PCE statements. Everyone agrees that many colleagues deserve medals, naps or both. Listeners’ questions from the Hidden REF Festival prompt discussions about non-traditional outputs, the effort required to submit them, and the broader ambitions of the 5% manifesto. The team emphasises that the goal is not to create NTOs for the sake of it, but to recognise existing work fairly and transparently. The episode closes with an exploration of PCE, its long-overdue role in improving research culture, and a collective hope that, with REF 2029, meaningful change may finally be on the way. If there’s anything about the REF that you would like us to investigate, please get in touch with wtref@hidden-ref.org. Our hosts are all members of the Hidden REF committee based at the universities of Southampton and Bristol: James Baker, Gemma Derrick - a self-confessed REF junkie - and Simon Hettrick, and our producer is Ben Thomas. Find out more about the HiddenREF campaign at Hidden-REF.org 'What the REF' is made possible by the Embedding Trust in Evaluation (E-TIE) research grant from Research England. Want to get in touch? Email: WTreF@hidden-ref.org WTreF is co-produced by Simon Hettrick, Gemma Derrick, James Baker and Ben Thomas. Video and Sound production by Ben Thomas. Hosted on Acast. See acast.com/privacy for more information.

    46 min

About

Welcome What the REF - Our attempt at demystifying everyone's favourite national research assessment exercise! Hosted on Acast. See acast.com/privacy for more information.