Setting meaningful public relations objectives: authority interviewed

Setting public relations objectives that are directly related to an organisation’s mission and operating or business plan is, so it seems, one of PR’s great challenges. It simply does not occur with any consistently applied methodology. But there are ways to create objectives – or KPIs – that are inherently and profoundly relevant to what an organisation is actually trying to achieve – let’s learn some ’secrets’…

Angela Sinickas is an internationally renowned public relations exponent and a passionate advocate for the setting of objectives – that have utility and are consistent in their application. Angela has been awarded 17 International Association of Business Communicators Gold Quills, teaches a graduate class on communication measurement and is widely published.

Angela Sinickas

Prior to her presenting a half-day workshop on Measuring ROI on communications (see below for free ticket if you are quick and have an insight) on 3 August for IABC NSW (sponsored by Ogilvy Public Relations Australia and St George Bank), Angela kindly answered a number of questions on this vexed issue.

A consistent KPI methodology

CP: Is there a straightforward methodology that can be applied to setting KPIs for public relations?

I think so. Start with a business goal.

Figure out which stakeholders need to change their behavior to better reach that goal. Research what knowledge and attitude messages will encourage the changed behavior, and which channels are most preferred for those messages.

Set targets for all of the above. Measure results through surveys and/or pilot/control groups.

Behaviour at the heart of PR KPI setting

CP: Considerable PR discussions and articles talk about PR KPIs being linked to organisational objectives, as well as them being “meaningful, reasonable and quantifiable.”^ To me, a lot of this discussion doesn’t provide anything of real substance and utility. What are your thoughts on the academic and business discussions on best practice meaningful KPI setting and the effective measurement of public relations activities?

I agree with you. They describe characteristics of good KPIs but not what you should set KPIs for. That’s why I always go back to my mantra above of knowledge, attitudes and behaviors—but created in reverse order. First figure out the behavior desired to make sure you’re working on the right knowledge and attitudes.

What are the primary notions to bear in mind when crafting KPIs for public relations strategies and programs?

Focus on measuring the desired outcomes first. Then measure only the activities (inputs) that your research identified as leading to those outcomes.

CP: Evaluation and KPIs tend to focus on the practical manifestations of a communication strategy (e.g. media relations, sponsorship). What are the implications of a relative lack of focus on measuring the strategy behind the tactics? How can we reduce the emphasis on the messenger being examined when, often, it should be the entity that crafted the message?

I don’t think we stop often enough to ask ourselves what we’re hoping to achieve, what will change, because of tactics like media relations and sponsorships. Until we clarify how we want to change the behaviors of people touched by our tactics, we won’t structure the events properly, or have the right key messages.

If we’re not doing the right things with our tactics to create intentional audience changes, it’s useless to measure the tactics themselves.

CP: You have written about how behaviour is the most important of the three potential dimensions resulting from communication-related activity (behaviour, perceptions, knowledge). Do you think this is forgotten in PR KPI setting sometimes and what are the fundamental reasons for prioritising behaviour over perceptions and knowledge?

If you don’t start with behavior, you’ll miss some of the most important key messages.

I often use an example from Malcolm Gladwell’s first book, The Tipping Point, where he describes a university health care clinic where the communicator wrote a brochure will all the key points the clinicians wanted on why students should get a tetanus vaccination:

  • They even pretested the brochure, and the students scored very high on knowledge of all the key messages
  • However, only 4% actually got a vaccination
  • When they asked some of the original students why, with all this correct knowledge in mind, they didn’t get vaccinated, the most common answer was that they didn’t know where the clinic was.

Now that was a key message for the audience, though it never occurred to the internal client and communicator because they worked there. Once they added a map to the brochure, with no other changes, 28% of the students reading the brochure got vaccinated. If they had just asked five students what they needed to know and believe in order to get the vaccination, at least four of them would have said, “I need to know where to go.”

Many of our clients’ key messages are usually totally unnecessary, and they’re often far enough out of touch with their stakeholders that they don’t know what messages might be missing.

How to evolve KPIs on an ongoing basis

CP: Once KPIs are set for PR programs, what methodology should be applied to their ongoing evolution from, for instance, year to year? I think a factor especially relevant to the change in KPIs is that knowledge, perceptions and behaviour can, arguably, only change so much. How do you determine when the change that has been achieved is optimum and from that point it might be more relevant for the knowledge/perceptions/behaviour to be maintained, rather than changed? What are your thoughts on this?

It’s easy when you start from a low baseline to set targets, but as you say, the annual increases will become smaller and smaller as you reach more of your audience successfully. I’ve covered this in more detail in an article.

The “optimum point” would very well be different for different things you’re measuring. For example, if you’re trying to improve the knowledge of employees on something, your best possible percentage score is going to be seriously limited by the rate of annual employee turnover.

If only 75% of the people with your company in January when you start your campaign are still with the company by the next January, 75% would be your maximum possible target (though still not a realistic one). You need to work down from levels that reality limits.

Another way to look at the optimum, or highest realistic, target is to look at benchmarks.

I have clients where we index their success on metrics captured through surveys by determining that they would receive the maximum number of points for an item if they reached the previously highest score achieved by any company on that same metric. They’d be doing an average job if their score was near the norm (average) for that question.

For metrics based on things like online usage, we’ll look at the number of page views or visitors for the previous year. We look at the highest number of visitors/visits for any particular webcast or publication and set that as the top possible score that we could receive the following year as the average for the year.

What did you think about what Angela said? Do you set what you consider to be meaningful KPIs for your communication strategies and programs? What are the issues you have in setting these KPIs; what are your challenges? NB. Angela also talks about a lack of measurement holding PR back in a future post.

 

Attention: a free ticket to Measuring ROI on communications, being presented on 3 August by IABC NSW, with the support of Ogilvy Australia and St George Bank, will be given to the person who provides the most interesting, value-adding comment to this post.*

About Angela Sinickas

Angela Sinickas, ABC, IABC Fellow, is president of Sinickas Communications, Inc., an international consulting firm that helps organizations plan and measure successful communication, including 23% of Forbes’ Global 100 largest corporations. She wrote the manual How to Measure Your Communication Programs and has earned 17 IABC Gold Quills. She also teaches an online graduate class on communication measurement for Northeastern University. Over 130 articles on communication planning and measurement can be read at www.sinicom.com

*The comment must be submitted by 9am Monday 2 August, Sydney, Australia time. I (CP) am the sole judge so don’t moan if you don’t like the arbitrary and subjective adjudication process! The winner must also be able to make the workshop, so unless you are willing to fly from Perth (Australia or Scotland), Southampton or Athens, don’t expect to win the ticket.


^Guidelines for Setting Measurable Public Relations Objectives: An Update; Anderson, Hadley, Rockland, Weiner; Institute of Public Relations; 2009

Related posts



  • http://www.thoughtleadershipstrategy.net/ Craig Badings

    Craig, Angela makes a lot of sense, however, most consultants know that when it comes to measurement, 90% of clients cut out the research/measurement element citing budget.

    I would love to research all campaigns, particularly before they start so one can properly benchmark the changes in behaviour, attitude and knowledge. Sadly it is the first part of a campaign the client cuts.

    This creates a vicious cycle for PR measurement and the profession because the alternative is often flaky measurement criteria without the proper research to back it up.

  • Paul

    Finally a conversation on measurement that does not mention AVEs. Agree that the only way to measure successfully is to set objectives and KPIs that can be measured.

    Too often PR blame budget and time as a rationale for not measuring and evaluating a campaign – no other business department could get away with that excuse and neither should we. It just needs to become part of how we do things.

  • http://www.sinicom.com Angela Sinickas

    Craig, while clients may not need to measure the success of a project because their management doesn’t require it, I find it’s much easier to explain the need for doing audience research before the campaign to make sure it will achieve the client’s objectives. That research can include a lot of very low-cost steps, from scanning social media comments to having the client talk to 10 people in the target audience asking questions you give them. Often, when clients start hearing unexpected answers to questions, they begin to understand the need to do more formal upfront research, which could be focus groups or a survey, to be sure the campaign will be on point.

  • http://www.sinicom.com Angela Sinickas

    I totally agree with you, Paul. Communicators don’t realize how easy and cheap highly effective evaluation can be. For example, a toxic waste disposal government entity each month placed ads in all local community newspapers and sent out news releases as well on a particular material they wanted brought in that month, like used engine oil or old car batteries. Of course, not all releases resulted in stories. I suggested a pilot program one month where they placed ads in only the newspapers serving the eastern half of the community. By comparing the percentage of the population who brought in the requested toxic material that month by postal code of the citizen, they could discover how much difference in impact there was in areas that had just an ad, just a news article, both, or neither. It cost less than a usual month’s budget because they spent only half their budgeted advertising dollars. The only time it took was to look at the computer report of postal codes from the forms people always needed to fill out at the waste dump and do the math to calculate the percentage of the local population that represented. No cost and very little time. I agree we need to stop making these excuses and just get more creative with our measurement approaches.

  • http://www.rfbd.org Andy O’Hearn

    I love Angela’s emphasis on actions as the drivers of the other metrics. In one of the pioneering texts of interpersonal communications — Watzlawick, P., Beavin, J., Jackson, D. (1967). Pragmatics of Human Communication: A Study of Interactional Patterns, Pathologies & Paradoxes — and also in the works of anthropologist Gregory Bateson, they repeatedly make the point that you cannot really tell a person’s state of mind, but you *can* deduce it from their actions. Per Aristotle: “”We are what we repeatedly do. Excellence, therefore, is not an act, but a habit.”

  • http://www.sinicom.com Angela Sinickas

    And, as Plato said, “Good actions give strength to ourselves and inspire good actions in others” so even more people do the right things.

  • http://www.CommunicationAMMO.com Sean Williams

    Craig and Angela – There just is no argument!

    When I was corporate-side (where I’ve spent most of my career, present 16+ months notwithstanding), unless the research cost nothing, it wasn’t ordered. One boss said, “that’s why we hired you. Your the expert.” I relied on environmental scanning, direct individual feedback, the Yahoo! message boards and other DIY methods to figure things out as I built the plan.

    However, two years in, I convinced everyone to let me do a comms survey myself, and two years later for the followup, got a few bucks to spend on professional statistical analysis. As it worked out, we got a lot of actionable info and used our research to change what we did in the plan.

    Keep fighting the good fight!

    Cheers,
    Sean
    @commammo

  • http://whytehallcommunications.wordpress.com/2010/08/01/learn-how-to-set-meaningful-pr-objectives/ Learn how to set meaningful PR objectives! « THE EXPOSURE!

    [...] Setting meaningful public relations objectives: authority interviewed [...]

  • http://craigpearce.info/public-relations/lack-of-measurement-holding-pr-back/ Lack of measurement holding PR back | Public relations and managing reputation

    [...] exponent and a passionate advocate for the setting of objectives, Angela Sinickas, the areas of behavioral change being of uppermost importance and how to evolve objectives were included in the conversation. [...]

  • http://craigpearce.info/public-relations/behaviour-wins-in-pr-strategy-objective-setting-2/ Behaviour wins in PR strategy objective setting | Public relations and managing reputation

    [...] aimed at changing knowledge or an attitude (that’s how we change behaviour). [...]

  • http://davidhartigan.wordpress.com/2010/08/22/week-5-reading-public-relations-research/ Week 5 Reading: Public Relations Research « David Hartigan's Blog for CMNS1290
blog comments powered by Disqus
Get Adobe Flash playerPlugin by wpburn.com wordpress themes