19 November 2020

Live Online Training (via Zoom) 09:30 - 17:00 BST

Bayesian Updating (Diagnostic Theory-Based Evaluation)

The UK Evaluation Society is pleased to be working with CECAN Ltd to deliver our Autumn 2020 Masterclass series for those working in consultancy, NGOs, Government, academia and other evaluation settings


Tutor:
Dr Barbara Befani, CECAN Research Fellow, has been developing evaluation methods for 15 years.  Her interests include 1) evaluation quality; 2) methodological appropriateness and comparative advantages and weaknesses of different evaluation methods; 3) ccausal inference frameworks for impact evaluation; and 4) specific hybrid, quali-quanti methodologies, like Qualitative Comparative Analysis (QCA) and Process Tracing (in particular its Bayesian formalisation, which she is extending to all forms of Theory-Based Evaluation).

Course Details:
This course covers the theory and practice of diagnostic evaluation and Bayesian Updating.  IT addresses its epistemological and mathematical basis, its appropriateness and strengths/weaknesses in comparison with other methods, and its application steps.

The method is focused on the empirical testing of propositions, including theories, causal statements and explanations, and its application steps will be addressed in three different modules, each coming with specific group work/exercises:

  1. 1) The formulation of theories/propositions and their implications for empirical testing;
    2) The design of data collection and the ranking of observations in terms of probative value and updating direction;
    3) The estimation of probabilities for use in the Bayes formula and the updating of confidence in the existence of non-existence of the theories/statements.
  2. The course includes presentations and case illustrations with prepared examples as well as more interactive discussion of evaluations participants are familiar with.
  3. Plan of the day

09:30 – 11:00
Recap of Theory-Based Evaluation, process Tracing and other methods based on generative causality.  Theoretical Introduction to BU/DE and its application steps.

11:00 – 11:20
Break

11:20 – 12:45
Step One : Developing Testable Theories (with group work)

12:45 – 13:45
Lunch

13:45 – 15:10
Step Two : Designing data collection seeking conclusive tests (with group work)

15:10 – 15:30
Break

15:30 – 17:00
Step Three : Assessing the evidence strength and updating confidence in theory (with group work)

Learning Outcomes

By the end of this session, participants will :

  • Gain a new perspective on Theory-Based Evaluation and what it takes to improve its credibility and reliability
  • Understand the connection between theory development and empirical observations
  • Learn to use the Bayes formula to update confidence in theories and claims
  • Gain understanding of Bayesian Process Tracing

Fees

£200 for Non-Members of UK Evaluation Society
£165 for Members
£130 for Student Members

To apply for a place on this course, please complete the form below ….
N.B.  Closing date for applications is 5 November

Thank you

You will shortly receive an invoice from UK Evaluation Society