Posts filed under ‘General’

Example: mixed methods in evaluation

We often talk about using mixed methods in evaluation but we rarely see examples that go beyond a combination of surveys and interviews. So I wanted to share an example of an evaluation that I thought was a good example of using a variety of methods.  I was part of a team (of the Independent Evaluation Office) that carried out an evaluation of knowledge management at the Global Environment Facility.

The methods we used included:
-Semi-structured interviews
-Online surveys
-Comparative study of four organisations
-Meta-analysis of country-level evaluations
-Citation analysis – qualitative and quantitative
citation_analysis_small
The image shows the visualisation of the citation analysis (carried out by Matteo Borzoni) by theme – interesting stuff! I feel that the range of data collected gave us a very solid evidence base for the findings.  The report is available publicly and can be viewed here (pdf)>>

November 1, 2018 at 9:23 am Leave a comment

Infographics to present evaluation findings

I’ve posted previously about using infographics to summarise evaluation findings; here is a recent example of using an infographic to present research results (click on the image to see larger and complete version); admittedly we packed a lot into this infographic – but still a good summary!
surge - final

August 7, 2018 at 8:53 am 1 comment

The global rise and future challenges for evaluation

Very interesting article from the latest edition of the newsletter of the European Evaluation Society “Evaluation between evidence‑based policy and “fake news”: paths to the future” (p. 3).

The article presents the reasons why there has been a global rise in evaluations and four future challenges, summarised here:

Why the global rise of evaluation:
1) In many countries, evaluation is a fixed element in policy-shaping and a management control element
2) The number of national evaluation societies has grown
3) Market for evaluation is continuing to grow
4) The dissemination of evaluation findings has surged
5) Training activities have increased

Future challenges for evaluation:
1) Increasing importance of global issues
2) The challenge of populist movements and “fake news” to evidence-based policy
3) Need for reflexive systems-thinking approaches
4) Increasing demand for participatory evaluation

View the full article (p.3)>>

June 5, 2018 at 11:51 am 2 comments

New resource: Social network analysis handbook

I just came networkacross this straight forward and practical guide to social network analysis (pdf) from the International Rescue Committee – well worth a read if you are interested in this method for your research and evaluation.

 

November 29, 2017 at 8:26 am Leave a comment

New insights on design and evaluation

designI recently attended the International Evaluation Conference of the Australasian Evaluation Society in September 2017 and one of the more interesting sessions I attended was on design and evaluation. This was all about the notion of the design phase of a project or service and how evaluators can be well placed to contribute to this phase. You can learn more in this post by Matt Healey, a speaker at this session.

 

October 3, 2017 at 8:23 am Leave a comment

New resources: measuring power shifts in favour of women

Evaluating shifts in power in society is very tricky to measure. ActionAid has just released a very comprehensive methodology pack on measuring power shifts in favour of women. Developed with Leitmotiv, it’s based on experiences in  Cambodia, Rwanda and Guatemala. View the resources>>

August 14, 2017 at 9:39 am 1 comment

Advocacy Evaluation Event: 14 June 2017, Washington DC

An evening reception for the launch of Annette Gardner and Claire Brindis’s book: Advocacy and Policy Change Evaluation: Theory and Practice that I mentioned last week.

With a great panel for the event:

ANNETTE L. GARDNER is Assistant Professor in the Department of Social and Behavioral Sciences at the University of California, San Francisco.

CLAIRE D. BRINDIS is Professor of Pediatrics and Health Policy and Director of the Philip R. Lee Institute for Health Policy Studies at the University of California, San Francisco.

DAVID DEVLIN-FOLTZ directs the Aspen Planning and Evaluation Program at the Aspen Institute and serves as the Aspen Institute’s Vice President, Impact Assessment.

JULIA COFFMAN founded the Center for Evaluation Innovation. She has more than 20 years of experience as an evaluator, and now specializes in the evaluation of advocacy, public policy, and systems change efforts.

SUE HOECHSTETTER is the Senior Advisor for Foundation Advocacy and Evaluation at Alliance for Justice and helps amplify citizen’s voices in the policy process.

Further information and registration>>

May 9, 2017 at 12:02 pm Leave a comment

Older Posts


Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 1,125 other followers

Categories

Feeds