“The integrated evaluation framework will guide you through the process from aligning objectives to establishing a plan, setting targets and then measuring the outputs, outtakes, outcomes and impact of your work.”
The new framework also comes with a taxonomy that describes for each step of the process the key steps required, the metrics and milestones and the methods that should be considered.
Here is a useful article from the Independent Evaluation Group of the World Bank. They highlight five tips to make your evaluation more influential as illustrated in the infographic below. I certainly agree with all the tips; I’d just add that influence may not be immediate and direct; it may take for some years to manifest itself and often in unexpected ways (to be explained in a future post!)
Here is an interesting briefing note from the Danish Refugee Council on “Monitoring and Evaluation in a Complex Organisation”
Monitoring and evaluation can be relatively straightforward processes within simple projects, and there are well established procedures that can be applied. However, as this Evaluation and Learning Brief highlights, M&E systems are much more difficult to design and implement at the level of complex organisations. The key here is to strive for balance between an M&E system with too much rigidity, which suits head offices but allows little room for flexibility at field level, and one with too much flexibility, which may lead to a loss of coherence throughout the organisation.
For any readers in the Zurich, Switzerland area, I will be giving a presentation for the EMScom Alumni Association (of which I am an alumni of..) on communication evaluation; here is a short description:
Evaluation of communication activities is consistently named as one of the top concerns of communication professionals. Yet paradoxically not even half reportedly undertake any evaluation. Drawing from his recent PhD studies and over a decade of experience in evaluating communication campaigns and programmes, Glenn O’Neil will set out the challenges and complexities of evaluation and offer insights into solutions and approaches to ensure that evaluation brings value to communication professionals and their organisation
Thursday, April 28, 2016, 18h30-21h00
Widder Hotel, Zürich
Cost: 50 CHF (free for EMScom alumni)
Hope to see some of you there! Further information >>
Register also by email: firstname.lastname@example.org
Here is an interesting short course from 5-21 April 2016 that can be taken online:
Presented by On Think Tanks, the course is for individuals and members of think tanks and other policy research organisations who are looking for viable and innovative ways to assess how their own research influences policy-making.
The course helps those looking to:
-Better reflect and enhance the impact of research in public policy,
-Satisfy their (and their donors’) interests in enhancing the uptake of research in policy,
-Build their reputation and visibility and attract more and better support to their work,
-Organise what they are already doing so that it can be useful for Monitoring, Evaluation and Learning purposes -and let go of processes that may not be useful.
Africa is a continent often the subject of many evaluations but rarely do we hear from evaluators in Africa. Well hopefully that is about to change with the newly launched Evaluation for Africa blog – with contributions from African evaluators – there are already some very interesting posts to read on assumptions in evaluation and thinking evaluatively.
The UN Joint Inspection Unit (JIU), an external oversight body of all of the United Nations, has just produced a very interesting study on Public information and communications policies and practices in the United Nations system (pdf)
Aside from providing an interesting and critical view of communications in the UN, the report also looks at the monitoring and evaluation (M&E) of communication activities – concluding that M&E needs to better feed into management directions and decision-making. Here are some key findings from the report on M&E and communications:
-Only half of UN agencies have included M&E in their communication frameworks
-Indicators used are predominantly output-based
-There is absence of an evaluation culture among communication staff
– Existing monitoring systems (e.g. for media coverage) were largely descriptive, rarely analysed and did not feed into decision-making.
View the full report here (pdf) – M&E aspects discussed from page 22 onwards.