New resource: Measuring Narrative Change

ORSImpact have produced an in-depth guide on measuring narrative change. The resource will be useful in communication and advocacy evaluation where we are often endeavouring to track and measure changes to the narratives of the pertinent issues. View the guide here>>

7102019_41124_521_Measuring_Narrative_Change_07_2019_Cover_thumbnail

May 28, 2020 at 1:06 pm Leave a comment

Measuring people power

MobLab has carried out a global study on how to measure people power – mobilising publics for campaigns and other initiatives. Here is an extract of the key takeawaysmpp-world-1:

key takeaways

For changemakers, if you’re not already measuring depth of supporter relationships and engagement (vs total numbers, or breadth), this report highlights a few ways to get started. Whether in a grassroots group, social movement, or an established NGO, tracking how committed people are to your mission (and to one another) and facilitating deeper relationships can be a big step forward.

For organisational leaders, this report is an urgent call to support cultures that are curious, innovative, and supporter- or people-centred. The results also clarified the importance of investing in staff and resources needed to build relationships with volunteers, grassroots, and community groups. The majority of the surveyed individuals found the very effort of measuring people power shifted and informed both tactics and strategy, guided day-to-day decision making, and was used to evaluate the past; essentially, to show them what was working and what wasn’t.

For funders, the results underscore the need to support organisations, groups and movements by investing in organising and power building, which don’t come with the same attractive metrics that we typically see in fundraising and digital advocacy. Funders should support both the implementation of sustained organising and supporter relationship building (outside of short term programme objectives) and ongoing development and experimentation in power building or “depth” metrics.”

View the report summary>>

May 14, 2020 at 12:54 pm Leave a comment

CART principles for monitoring

Innovations for Poverty Action have developed some useful guidance on activity monitoring and evaluation based on their own CART principles: credible, actionable, responsible, and transportable (see summary graphic below).

Particularly useful for those interested in monitoring which is an issue many organisations find challenging. Read more here>>

CART-Principles-Diagram

May 7, 2020 at 12:36 pm Leave a comment

Evaluation during COVID19 – infographic

Here an informative infographic from UNDP independent evaluation office on evaluation during COVID19 (view the pdf version here).
Eval_COVID19

 

 

April 30, 2020 at 11:07 am 1 comment

Evaluation and COVID19

There have been many useful and interesting articles on how evaluation can adapt and cope with the current COVID19 pandemic. Here is a collection of what I’ve found to date:

Practical tools/advice:
Conducting phone-based surveys during COVID 2019

A quick primer on running online events and meetings

Covid-19 crisis: how to adapt your data collection for monitoring and accountability

Think pieces:

Zenda Ofir: Evaluation in times of COVID19 outbreak

World Bank: Conducting evaluations in times of COVID-19

Chris Lysy: The Evaluation Mindset: Evaluation in a Crisis

M Q Patton: Evaluation Implications of the Coronavirus Global Health Pandemic Emergency
covid-19_

April 23, 2020 at 10:55 am 1 comment

Integrating communications in evaluation – presentation slides

Earlier this year I gave a presentation on “integrating communications in evaluation” and I am now happy to share the presentation slides of the event:

 

March 19, 2020 at 1:16 pm 1 comment

Advocacy evaluation resources

Here is a non-exhaustive list of some advocacy evaluation resources available online  (n.b. most links will take you directly to a PDF document).

Theory of change:
Julia Coffman & Tanya Beer (2015), The Advocacy Strategy Framework; A tool for articulating an advocacy theory of change

UNICEF (2014), Theory of change; methodological briefs 

Advocacy monitoring and evaluation methods/approaches:

Saferworld learning paper (2016), Doing things differently – rethinking monitoring and evaluation to understand change (outcome mapping and harvesting)

Robin Kane et al (2017), Contribution Analysis in Policy Work; Assessing Advocacy’s Influence

Harvard Family Research Project (2009), A User’s Guide to Advocacy Evaluation Planning

Julia Coffman (2019), Current Advocacy Evaluation Practice, Center for Evaluation Innovation.

Julia Coffman and Ehren Reed (2019), Unique Methods in Advocacy Evaluation

Intrac (2009), Tracking Progress in Advocacy: Why and How to Monitor and Evaluate Advocacy Projects and Programmes

Oxfam, Process Tracing – Draft Protocol

Guidelines:

CARE (2018), Advocacy and Influencing MEL Guidance

UNICEF, Monitoring and evaluating advocacy; companion to the advocacy toolkit

CIPPEC (2011), Learners, practitioners and teachers; Handbook on monitoring, evaluating and managing knowledge for policy influence

ODI (2014), Monitoring and evaluation of policy influence and advocacy

Communicating monitoring and evaluation results:

Glenn O’Neil (2017), A Guide: Integrating Communication in Evaluation

CDC (2013), Evaluation Reporting: A Guide to Help Ensure Use of Evaluation Findings

“Think pieces” on advocacy evaluation:

Bodille Arensman (2019), Advocacy Outcomes Are Not Self-Evident: The Quest for Outcome Identification

Jim Coe and Rhonda Schlangen (2014), The value iceberg: weighing the benefits of advocacy and campaigning

Jim Coe and Rhonda Schlangen (2019), No Royal Road: Finding and Following the Natural Pathways in Advocacy Evaluation

Jim Coe and Juliette Majot (2013), Monitoring, evaluation and learning in NGO advocacy; Findings from Comparative Policy Advocacy MEL Review Project

Annette L. Gardner and Claire D. Brindis (2017), Advocacy and Policy Change Evaluation: Theory and Practice (a book!)

Examples of advocacy evaluation reports:

UNHCR (2019), Evaluation of Effectiveness and Relevance of Advocacy Approaches in Europe

Norwegian Refugee Council (2014), Evaluation of NRC’s 2012-13 protection and advocacy work in the DRC

Oxfam America (2015), Evaluation of global advocacy programme; Global Leaders Empowered to Alleviate Poverty

Norwegian Refugee Council (2015), Evaluation of global advocacy initiative on housing, land and property

Oxfam International (2013), Evaluation of global communications campaign GROW

February 19, 2020 at 6:54 pm 2 comments

Older Posts


Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 1,145 other followers

Categories

Feeds