Posts filed under ‘Communication evaluation’
Measuring the impact of journalism 2
We don’t often read or hear about measuring the impact of journalism, as I’ve written about previously.
Well, on this topic, here is a very interesting article from Stanford Social Innovation Review that goes quite in-depth on the subject. They talk about measuring reach, impact, engagement and influence together with providing examples and initiatives underway in this area.
Barcelona Principles 2.0 launched
Developed five years ago by International Association for Measurement and Evaluation of Communication (AMEC) and partners, the first overarching framework for effective public relations (PR) and communication measurement (“Barcelona Principles”) has just been updated. See the infographic below that illustrates the changes. Read more about the changes here.
Evaluating communication products – an example
I’ve written previously about the challenge of evaluating communication products – websites, brochures, videos and reports – rather than a communication campaign or programme as a whole.
I’ve just been involved in carrying out an evaluation of products for ACAPS, an NGO focused on assessment in humanitarian crises – and as part of their mandate they produce analytical products (mainly reports) on crisis situations globally. To carry out the evaluation, we undertook 40 interviews with users of their products and then analysed and categorised the type of use, satisfaction ratings and unmet needs. You can view the evaluation report here (pdf)>>.
New online hub – learnings from the IF campaign
Bond (UK NGO body) have created an online hub of campaigning effectiveness resources based on the lessons and recommendations of their IF campaign.
More than 30 individuals have shared their expertise in 7 areas of coalition campaigning to produce some 20 resources. They give top tips, reflections and ideas on topics ranging from digital campaigning to how to structure coalition campaigns. In addition you’ll also find interesting campaigning tools to assist with common campaigning issues.
The “Inspiration” mini-cases are particularly interesting for those working on campaigning and seeking to learn what “works” for others.
Insights into global advocacy: Oxfam’s GROW campaign
I recently spoke at the Graduate Institute in Geneva for the students of the Certificate in Advocacy in International Affairs – presenting a case study on Oxfam’s GROW campaign – drawing insights on global advocacy campaigns. My presentation is below:
5 handbooks on communication evaluation
I’ve been reviewing what handbooks and guides are available on communication evaluation – so far I’ve located five, here they are (all links to PDFs):
Communication Network (2008) Are we there yet? A Communications Evaluation Guide
DFID (2005). Monitoring and Evaluating Information and Communication for Development (ICD) Programmes – Guidelines. Department for International Development, London.
EETAP (2002), Guidelines for Developing and Evaluating Communicatioon Tools/Efforts
Slighty more specialised, but still interesting:
USAID (2007) Guide to Monitoring and Evaluating Health Information Products and Services
New PR Research & Measurement Standards available
The Coalition for Public Relations Research Standards has just released their interim metrics (pdf) on PR research and measurement. They’ve split it by traditional media, social media, communications lifestyle and Return on Investment (ROI). For each metric, there is also more information available. I’m yet to go through all the information, but it seems like a comprehensive list – even if not all will agree on the different definitions, etc. Of interest, four major US corporations – GE, GM, McDonald’s USA and Southwest Airlines – reportedly have already adopted these metrics.
New article – PR Measurement and Evaluation Practices Over the Course of 40 Years
Here is a brand new article (it’s a chapter from a book*) by Fraser Likely and Tom Watson entitled “Measuring the Edifice – PR Measurement and Evaluation Practices Over the Course of 40 Years”.
It provides an excellent overview of developments in the last 40 years and the challenges currently faced in PR measurement and evaluation. A summary from the authors:
“Public relations measurement and evaluation practices have been major subjects for practitioners and academician research from the late 1970s onwards. This chapter will commence with a brief survey of the historical evolution of the research into these practices. Then, we will discuss James E. Grunig’s enduring contribution to their theorization, particularly with financial and non-financial indicators of public relations value. Next, we will consider the current debate on financial indicators, focusing on Return on Investment and alternative methods of financial vlauation. Finally, we will look to the future at the measurement and evaluation practices that will attract academic and practitioner research interest.”
View the article/chapter in full (pdf)>>
*Note: Fraser and Tom’s chapter, “Measuring the Edifice: Public Relations Measurement and Evaluation Practice Over the Course of 40 Years (pp. 143-162)” comes from a “festschrift” (a celebratory book) for Professors Jim and Lauri Grunig – two renowned PR Gurus – which was edited by Professors Krishnamurthy Sriramesh and Ansgar Zerfass and Dr Jeong-Nam Kim. The book’s title is Public Relations and Communication Management: Current Trends and Emerging Topics. It is published by Routledge.
New article: Evaluation of IO/INGO communication activities
I’ve just had an article published in the journal PR Review. It’s the first article of my ongoing PhD on communication evaluation in intergovernmental organizations and NGOs. Below is the Abstract or if you are really keen you can download the full article below.
Abstract
Evaluation of international and non-governmental organizations’ communication activities: A 15 year systematic review
The purpose of this paper is to understand how intergovernmental organizations and international non-governmental organizations have evaluated their communication activities and adhered to principles of evaluation methodology from 1995–2010 based on a systematic review of available evaluation reports (N = 46) and guidelines (N = 9). Most evaluations were compliant with principle 1 (defining communication objectives), principle 2 (combining evaluation methods), principle 4 (focusing on outcomes) and principle 5 (evaluating for continued improvement). Compliance was least with principle 3 (using a rigorous design) and principle 6 (linking to organizational goals). Evaluation was found not to be integrated, adopted widely or rigorously in these organizations.
The PR Agency Of The Future – measurement and data!
Paul Holmes of the Holmes Report has written a very interesting article on what he sees as key to the future of the PR agency.
For those interested in PR measurement, what is reassuring is the focus he puts on the need for the better use of data and measurement by agencies. I’m always surprised to see how little PR agencies do in measurement – so any more uptake of evaluation and measurement would be welcome.
Here is a summary of some key points:
- Big data at the center: Sufficient evidence suggests data and analytics can have a powerful effect on communications. There has been an incremental increase in the use of data to drive PR efforts, but the progression is minimal.
- Insight to drive meaningful creativity: Strong data will lead to better insights, giving way to creative PR ideas that effectively solve real world problems. Don’t assume your experience is enough to make a good campaign – use data.
- Understanding the human brain: To better understand how to change behaviors and attitudes, PR pros should read and listen to neuroscientists like David Eagleman. After all, PR is a social science.
- Recruiting differently: Practitioners who understand and even love data exist, but firms need to recruit a broader, more digestive range of people to find them. Seemingly unrelated disciplines should not be ruled out.
- Make it matter: To ensure communications efforts pay off in business terns, every campaign, every stakeholder group, and every advance in how we apply data and science can and should be measured.
intelligent measurement 