6 July 2022

Online via Zoom, 13:00 - 14:00 BST

WEBINAR – Evaluation Guidance – What makes the difference ?

Prof Laurence Moore on MRC Framework Guidance, comments from Dr Helen Wilkinson and Martha Bickett from Magenta Guidance, and Susanna Morrison-Metois on ALNAP guidance (humanitarian sector).

There is a lot of evaluation guidance available – some general; some linked to specific sectors, some to specific methods, and some linked to institutions.  Some are more accessible than others.  For many practitioners guidance is a key interface with evaluation good practice.  So what makes the difference?  What sorts of issues do you need to bear in mind to make guidance useful?  How do you know the guidance is useful, influential indeed effective?

We are delighted to welcome Professor Laurence Moore from the Social and Public Health Sciences Unit, University of Glasgow, to discuss in this light, the recently revised Medical Research Council guidance : A new framework for developing and evaluating complex interventions.  Dr Helen Wilkinson and Martha Bicket who worked on the supplementary guidance: Handling Complexity in Policy Evaluation, for the UK Government Magenta Book revision 2020 will provide initial comments in light of their experience.  Susanna Morrison-Metois from ALNAP will also share her experience from humanitarian sector guidance, before opening up to wider discussion with the participants.

The full version of the MRC Framework was published by the NIHR https://www.journalslibrary.nihr.ac.uk/hta/hta25570/#/abstract while a short paper summarising the new framework was published in the British Medical Journal https://www.bmj.com/content/374/bmj.n2061.

Professor Laurence Moore is a social geographer by background and has led interdisciplinary teams on the evaluation of both researcher led and government led public health interventions and policies for 30 years.  He was founding Director of the DECIPHer research centre in Cardiff and has been Director of the MRC/CSO Social and Public Health Sciences Unit, University of Glasgow, since 2013.  Laurence has substantial experience of numerous funding board, principally for the NIHR and UKRI MRC.

Helen Wilkinson is a Director of Risk Solutions and has worked for a wide range of public sector clients on evaluation and policy support, including Defra, BEIS, HSE and DfT.  She is a member of the Executive Group of CECAN and was a co-author, with Martha Bicket and other CECAN members, of the Magenta Book Supplementary Guide on Handling Complexity in Policy Evaluation and Defra’s Complexity Evaluation framework.

Martha Bicket is a Senior Research Fellow at the University of Surrey and a member of CECAN specialising in sustainability policy and the management and evaluation of complex systems.  Martha led the development of the Complexity Evaluation Framework for Defra and, along with Helen Wilkinson and others, is one of the authors of HM Treasury’s Magenta Book Supplementary Guide on Handling Complexity in Policy Evaluation.

Susanna Morrison-Metois is a Senior Research Fellow at ALNAP, the global humanitarian learning network.  She leads ALNAP’s work on evaluation and coordinates outreach to M&E staff in 100+ ALNAP member organisations.  She recently co-authored an ALNAP publication on Real-Time Evaluation and Real-Time Learning and is currently working to update ALNAP’s Guidance on Using the OECD DAC Criteria in Evaluations of Humanitarian Action.  Prior to joining ALNAP she worked for the Irish Government (Irish Aid) and for the Organisation for Economic Cooperation and Development (OECD) where she worked on evaluation and evaluation policy, forced displacement and broader development policy issues. Susanna has also worked in operational humanitarian roles with the International Committee of the Red Cross (ICRC) and NGOs in a number of crisis and post-crisis contexts.

ALNAP’s Guidance on Using the OECD DAC criteria in Evaluations of Humanitarian Action:


Members free.