« Outputs and Outtakes and Outcomes -- Oh My! | Main | Social Media: Hype Curve or Big Bucks? »
An Example of Confused Terminology
A recent article published in the PRSA's new PR Journal provides a example of how poorly the terms "output", "outtake" and "outcome" are understood in the industry, even in this peer-reviewed publication which features articles from the leading academics and industry practitioners.
My recent post, "Outputs, and Outtakes, and Outcomes Oh My!" lamented how frequently I see these terms misused. In addition to the comments I got on the blog, I had email exchanges with several people. One member of the IPR's Measurement Commission said "I'm extremely puzzled how anyone could possibly misinterpret outputs (which only relate to mentions) with outcomes (which must relate to attitude or behavior reinforcement or change)."
I didn't have to look far for an example.
In this paper titled "The Application of "Best Practices" in Public Relations Measurement and Evaluation Systems" published in the first issue of the PR Journal, EchoResearch's President David Michaelson and CEO Sandra Macleod, noted as "two of the world's leading experts in communications research and measurement", ouputs and outcomes are used incorrectly if you take, as I do, the IPR's Guidelines for Meauring the Effectiveness of PR Programs and Activities authored by Prof. Walter Lindenmann as the standard definition. (Note: David Michaelson is on the Institute for PR's Commission on Public Relations Measurement & Evaluation under whose aegis the guidelines were published.)
Before I address the misuse of the term, let me say the paper is useful and, for PR practioners unfamiliar with conducting market research it should be a "must read" to understand the basics of constructing a valid research methodology. However, IMHO, it falls short of delivering the "best practices" by skimming over the tough issues of how to isolate PR's impact from other marketing/communications/sales activities and how to link PR to sales. But this is a topic for another post, perhaps.
Back to the example. On page 3 of the paper, Michaelson and Macleod write:
"Companies specializing in public relations measurement and evaluation have traditionally focused on evaluating only the outcomes of public relations. These outcomes are most commonly the media or press coverage that is a direct result of media relations activities (outputs)."
These two sentences say that outcomes are the number of clips or impressions while outputs are the number of press releases issued, perhaps the number of reporters called or who attended a press conference, etc.
Here are Lindenmann's definitions on page 7 of his paper:
"...PR outputs, which are usually short-term and surface (e.g., the amount of press coverage received or exposure of a particular message)..."
"...PR outcomes (e.g., did the program or activity change opinion and attitude levels, and possibly behavior patterns?)."
If the experts and members of the IPR Measurement Commission don't use the terms accurately, the rest of the industry will be confused, as I believe they are today.
Why do I rant about this? We all know words are important -- that's why we do what we do. We also know that words come with certain associations and connotations from everyday usage and I believe the terms "outputs" and "outcomes" are commonly used in ways that are dramatically different than what the IPR intends. (Outtakes is just a strange word that only exists, perhaps, in the world of film editing.)
Michaelson's and Macleod's misuse of outputs above is an example where common usage gets substituted for the official definition. If someone asked me what my output was today, I'd probably answer "a blog post, 35 emails, and 3 meetings" or something. When a CEO thinks of outputs, he probably thinks about how many widgets come off the assembly lines of his factory, not the number of his widgets on store shelves. Thus when a CEO (or other non-communications exec) hears the term outputs in association with communications activities, she probably thinks in terms of the activities of the PR staff as Michaelson and Macleod describe them, and not how many articles the company was mentioned in. And, as I have said before, I believe the only "outcomes" C-level staff are interested in are those that contribute financially to the firm's performance.
It is natural for people to apply their common understanding of terms when they hear them in a new context. It is a lot of work to try to wrap new meanings around them and have those new meanings widely accepted. The IPR and PRSA need to either step up efforts to educate the industry on the correct use of these terms or consider changing them to terms that are understandable based on their common usage.
I believe change is the preferred course. My nominations for new, more readily understandable terms are:
- Media Influence: clips, impressions, message pick up that indicate that PR activities and programs influenced the media to distribute the intended information
- Audience Influence: perceptual or attidudinal changes that indicate the intended audience saw the information, paid attention to it, and that the desired change took place
- Business Influence: sales, stock price, or brand equity valuation increases that are linked to these activities
What's your vote: change or stick with outputs/outtakes/outcomes?
Posted by Jim Nail on November 5, 2007 at 07:38 AM | Email this post
Permalink
Technorati Tags: PR Measurement, Public realtions Measurement
TrackBack
TrackBack URL for this entry:
http://www.typepad.com/t/trackback/331182/23054544
Listed below are links to weblogs that reference An Example of Confused Terminology:
Comments
Outtakes end up on the cutting room floor (though some provide comedy during the closing credits). That's what everyone else hears. Is that an education problem?
I'm reminded of Frank Luntz's work in identifying the right words to reach an audience. Rather than educate the audience on what you meant (your execs have time for that?), why not adjust your own terminology to something the audience will understand?
Posted by: Nathan Gilliatt | Nov 5, 2007 10:57:24 AM
Thanks Nathan!
I'll take that as a vote for change!
Posted by: Jim Nail | Nov 5, 2007 11:01:39 AM
Jim, I think one factor you have to consider is that PR can now be measured by so many more meaningful metrics. The fact that I can tell not just how many "eyeballs" saw my YouTube video, but I can count how many people rated it, and what the average rating was and how many people commented on it -- all tells me much more about the level of engagement I have with my customers than simple outputs or outcomes. Engagement, I think falls somewhere in between.
Posted by: KD Paine | Nov 6, 2007 2:24:53 PM
Agreed these are interesting indicators. But this raises two issues: how do we avoid metric proliferation ("on this initiative, we had 1000 clickthroughs to our web site, 10,000 views of our YouTube, 100 comments on our blog post, 2000 people became new Facebook friends..." ad infinitum). This is a case where more metrics lead to less clarity about the impact.
Question #2 is the real question: how can we use these types of metrics as proxies for the overall impact? This is where we need research to help us quantify this overall effect.
Posted by: Jim Nail | Nov 6, 2007 2:54:12 PM
Jim, I applaud your fight back against the fuzziness and confusion that occupies this corner of PR. Your proposed measures are with considerable merit and I believe could gather currency with practical illustrations. We all agree the traditional 'takes' are misused and if they are to be the chosen ones then there is an earnest need for education far beyond the meaningful discussions on blogs. There really has to be a growing-up moment for PR.
Posted by: Michael Blowers | Nov 9, 2007 12:40:06 PM
Thanks Michael. I appreciate the support. Since this article I have been pointed to the definitions in the IPR's Dictionary of Public Relations Measurement and Research as the official ones. I find them much less clear than Lindenmann's -- but another case where too many different sources of different definitions create confusion that hurts the industry's ability to make progress on the big issues.
Posted by: Jim Nail | Nov 9, 2007 1:54:20 PM



