Addressing causation in humanitarian evaluation

A new discussion paper has been released by ALNAP entitled “Addressing causation in humanitarian evaluation: A discussion on designs, approaches and examples”.

The paper discusses possible evaluation designs and approaches that can help provide credible answers to these types of questions, using examples from Oxfam, WFP, UNHCR and NRC.

The paper cites an evaluation I worked on with NRC in the realm of advocacy evaluation.

View the paper here>> 

February 10, 2015 at 3:00 pm 1 comment

The checklist as an evaluation tool: examples from other fields

 Rick Davies of the Monitoring and Evaluation NEWS blog has published an interesting post exploring how surgeons and pilots use checklist – and lists other interesting resources on this issue.

See also my earlier posts here and here on using checklists.

January 15, 2015 at 2:48 pm Leave a comment

Advocacy evaluation using contribution analysis

A challenge of advocacy evaluation is in analysing and interpreting data and information in a systematic and rigorous manner.  For a recent advocacy evaluation I carried out with my colleague Patricia for the Norwegian Refugee Council,  we used a simplified content analysis to assist us with this task.

In carrying out this analysis, we asked four questions:

1) What were the policy changes desired by NRC (“the asks”)?

2) What were the reaction of targeted institutions, individuals and allies to these asks?

3) What was the level/significance of policy change (if any)?

4) What was the role of NRC in any change seen?

We then summarised this in a table, listing the some 30 (!) policy asks of NRC’s advocacy, here is an extract:

Ask Reaction Change seen Role of NRC advocacy
UNICEF and partners need to adapt RRMP to include assessment of protection needs. UNICEF deployed protection specialist for six months to work with RRMP. High High
Organisations need to ensure that pressure to move quickly does not marginalize commitment to longer-term work with more impact. This and broader thinking of report taken on-board in creation of DRC DMG network. Medium Medium
(NRC advocacy was one of many influences on DMG)

View the full report here (pdf) (see annex 1 for the contribution analysis table, page 27)>>

January 6, 2015 at 8:35 am 2 comments

New resource: the value iceberg: weighing the benefits of advocacy and campaigning

Rhonda Schlangen and Jim Coe (independent evaluation consultants) have just published a very interesting paper “The value iceberg: weighing the benefits of advocacy and campaigning” on the BetterEvaluation website.

The paper looks at how concepts of ‘value’ and ‘results’ are being applied to advocacy and campaigning and presents some alternative strategies for assessing advocacy. You can see the “value iceburg” below.

View the paper here>>

December 19, 2014 at 4:37 pm Leave a comment

6 ideas for displaying qualitative data

In a recent blog post, Ann K. Emery sets out 6 great ideas for displaying qualitative data:

  1. Word clouds
  2. Showcasing Open-Ended Survey Data Beside Closed-Ended Data (see example below)
  3. Photos Beside Participants’ Responses
  4. Icons Beside Descriptions and Responses
  5. Diagrams to Explain Concepts and Processes
  6. Graphic Timelines

Read her full post here>>

Example of point 2 from Anne K. Emery: 

December 9, 2014 at 11:44 am Leave a comment

New resource: Network Analysis from Start to Finish

Here is an excellent presentation on network analysis and evaluation originally presented at the America Evaluation Conference 2014:

Network Analysis from Start to Finish:Techniques, Tools, and Tips for Evaluating Your Network by Bobbi J. Carothers (pdf) >>

November 14, 2014 at 12:01 pm Leave a comment

Four challenges and opportunities for communicating evaluation findings

I’m currently in Uganda where I’ve been conducting a workshop on “communicating evaluation findings effectively” as part of the GIZ project on Evaluation Capacity Development in Uganda.

I also made a presentation  for the Uganda Evaluation Association as part of their Kampala Evaluation Talk series, focusing on “Four challenges and opportunities to communicating evaluation finding” which can be seen below.

Thanks to the participants of both the workshop and the talk for their enthusiasm and interest!

October 19, 2014 at 3:29 pm 2 comments

Older Posts

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 941 other followers




Get every new post delivered to your Inbox.

Join 941 other followers