KNOWLEDGE SHARING WORKSHOP FOR EVALUATION MANAGERS: country programme evaluation

KNOWLEDGE SHARING WORKSHOP
FOR EVALUATION MANAGERS:
How to design and conduct a
country programme evaluation
EvB
DOS
Africa
Region
Agenda
WORKSHOP FOR THE AFRICA REGION
Resource Persons
1. Alexandra Chambel– Evaluation Adviser, Evaluation Branch,
Division for Oversight Services, New York
CPE
2. Hicham Daoudi – Evaluation Adviser, Evaluation Branch, Division
for Oversight Services, New York
3. Mahbub Alam, Regional Adviser, Monitoring & Evaluation,
EECARO, Istanbul
M&E
4. Reginald Chima – Regional Adviser, Monitoring & Evaluation,
Johannesburg
Rapporteurs
1. Thulile Zondi
2. Zippora Gathiti
3. Charles banda
4. Messay Teferi
5. Philomena Ochurus
Johannesburg, South Africa
June 25- 29, 2012
Africa Regional Office and
Evaluation Branch at the Division for Oversight Services
United Nations Population Fund
Day 1
10:30
MODULE 1 – INTRODUCTION
Module topic
Presenter
Registration
Opening remarks
Ms Lina Mousa,
Deputy Director
Africa Regional
Office
Introduction
Reginald Chima
Course presentation
Hicham Daoudi
Structure of the Handbook
Alexandra Chambel
Overview of the phases of a
CPE
Debate: Q&A
11:00
Coffee break
Time
8:30
9:00
9:30
9:40
10:00
11:20
12:00
12:15
MODULE 2 – PREPARATORY PHASE
Drafting the ToR
Hicham Daoudi
Selecting and recruiting the
evaluation team
Establishing the reference group Alexandra Chambel/
and the quality assurance
Reginald Chima
process
Debate: Q&A
Rapporteur
Thulile Zondi
Catherine Nwokolo
Zipporah Gathiti
Bernard Mijoni
13:00
14:30
Lunch break
Preparing initial documentation
Charles Banda
Tengetile Tsabeze
Exercise: prepare a list of
documents
15:00 Preparing list of Atlas projects
Alexandra Chambel
by CPAP output and Strategic
Plan Outcome
Preparing stakeholders mapping
Exercise: complete the
beneficiaries column of the
Stakeholders’ mapping table
15:45 Coffee break
16:00- Debate: Open discussion on the role of the evaluation managers in the
17:00 preparatory phase. Opening question: do current resources, organisational
structures and internal capacity at Country Offices allow evaluation managers
to carry out their role in the preparatory phase? What are weaknesses in this
regard and how could they be overcome?
2
Day 2
Time
9:00
9:30
10:30
MODULE 3 - DESIGN PHASE
Module topic
Presenter
CPE wider Framework
The CPE internal framework
Alexandra Chambel
(ToRs)
Country context and UNFPA
response
Intervention logic
Hicham Daoudi
Evaluation criteria
Debate: Q&A
Rapporteur
Messay Teferi
Keumaye Ignegongba
11:00
11:20
12:00
12:45
14:15
Coffee break
Evaluation questions
Alexandra Chambel
Debate: Q&A
Lunch break
From a sample of stakeholders
Philomena Ochurus
to the CPE overall agenda
Alexandra Chambel
Isam Taha
14:30 Data collection methods
Validity of findings
15:00 The Evaluation Matrix
Hicham Daoudi
15:45 Coffee break
16:00- Group exercise: participants will assess the quality of an Evaluation Matrix.
17:00
3
Day 3
Time
Module topic
Presenter
Rapporteur
9:00
Group presentations: Results of the Evaluation Matrix exercise will be
presented and discussed with the entire group. Discussions will be facilitated
and guided by trainers and will conclude with a final wrap-up of the main
learning points and difficulties and the way to overcome them.
10:30 Brief presentation of the outline Hicham Daoudi
of a Design Report
11:00 Coffee break
11:15 Debate: Open discussion on the role of the evaluation managers in the design
phase. Opening question: do current resources, organisational structures and
internal capacity at Country Offices allow evaluation managers to carry out
their role in the design phase? What are weaknesses in this regard and how
could they be overcome?
12:45 Lunch break
14:15
15:45
16:00
16:45
17:15
MODULE 4 - CONDUCTING THE EVALUATION
Starting the field mission –
overview
Alexandra Chambel
Vertha Dumont
Raymond Berthe
General
briefing
(plenary
session)
Data collection – practical
considerations
Coffee break
Data analysis – practical
Marie
Francois
considerations;
chain
of
Engulu Bosango
reasoning of the evaluation Hicham Daoudi
Eduardo Juarez
(evidence-based
reasoned
judgments
Presenting preliminary results
Debate : Open discussion on the role of the evaluation managers in the field
phase/whilst the evaluation is conducted. Opening question: do current
resources, organisational structures and internal capacity at Country Offices
allow evaluation managers to carry out their role in the field phase? What are
weaknesses in this regard and how could they be overcome?
4
Day 4
Time
9:00
9:25
9:45
11:00
11:15
11:40
12:30
13:00
14:30
16:00
16:15
16:20
16:40
17:15
MODULE 5 - REPORTING PHASE
Module topic
Presenter
Rapporteur
Pierre Sota
Assessment of the M&E system Alexandra Chambel
Judith Shongwe
of the CO
Hicham Daoudi
Presentation of the CPAP Reginald Chima
indicator quality assessment grid
Debate: Q&A
Facilitator: Reginald Chima
Group exercise: participants will assess the quality of the indicators of a
results framework
Group presentations: Results of the exercise will be presented and discussed
with the entire group.
Coffee break
The Evaluation Report –
Denis Wani
structure and template
Alexandra Chambel
Rudo Mhonda
Evaluation Report – review
process
Evaluation Quality Assessment Hicham Daoudi
(EQA)
Debate: Q&A
Facilitator: Mahbub Alam
Lunch break
Group exercise: participants will assess the quality of 1 EQA
Group presentations: Results of the exercise will be presented and discussed
with the entire group.
Coffee break
Beyond the reporting phase:
Tesfa Fessahaie
Management
response,
Alieu Sarr
dissemination and follow up
Alexandra Chambel
Presentation of a concrete Reginald Chima
example of a Management
Response
Debate: Open discussion on the role of the evaluation managers in the
reporting and dissemination phases. Opening question: do current resources,
organisational structures and internal capacity at Country Offices allow
evaluation managers to carry out their role? What are weaknesses in this regard
and how could they be overcome?
Day 5
Africa Regional Strategy on RBM PM&E
5
Time
9:00
9:25
9:45
11:00
11:15
11:40
12:30
13:00
14:30
Module topic
Presenter
Rapporteur
Africa Regional Programme Reginald Chima
Messay Teferi
Keumaye
Ignegongba
Action Plan
Outcomes and Outputs of the
Africa Regional M&E Strategy
Group exercise: participants will assess the quality of the indicators of a
results framework
Group presentations: Results of the exercise will be presented and discussed
with the entire group.
Coffee break
Strategic Activities of the Africa Marie
Francois Denis Wani
Regional RBM/PM&E Strategy Bosango
Zipporah Gathiti
Thulile Zondi
Strategic Indicators of the
Andre Kone
Africa Regional RBM/PM&E
Raymond Berthe
Strategy
Francois
Presentation of Draft Africa Marie
Regional
RBM/PM&E Engulu Bosango
Keumaye Ignegongba
Strategy 2012 -2017
Final Discussion and Way Forward
Closure & Departure Reginald Chima
Reginald Chima
Lunch break
6