A New Framework for Social Media Metrics and Measurement

12 Jun

Last week in Madrid, AMEC (International Association for the Measurement and Evaluation of Communications) held their 5th European Summit on Measurement. This one was entitled, Unlocking Business Performance – Communications research and analytics in action. One underlying premise of the program this year was that the time for talk is behind us and the time for action and putting into place the principles and practices of sound measurement is upon us. The later part of the program featured an update from Salience Insight Commercial Director Mike Daniels on social media standards including the recently published standardization effort from the cross-industry group called The Conclave which may be found here.

Once Mike discussed where we are with respect to standardization, Richard Bagnall (@richardbagnall), Chairman of the AMEC Social Media Measurement Group, and I as his vice-chair, presented a session on creating a new recommended framework for social media metrics and measurement. Essentially we tried to answer the question: how do we take the standards work coming from The Conclave and operationalize it to create proper social media measurement? Here is an overview of what we presented and what we are encouraging everyone to adopt and use. The framework templates, usage guide and a short video synopsis will be available for download from the AMEC website, Social Media Measurement section, in the next week or so.

Valid Metrics Framework and Social Media

Our journey begins with the Valid Metrics Framework, a measurement planning framework and template developed under the auspices of AMEC. The framework was designed to be flexible enough to address multiple aspects of public relations within a consistent measurement framework and approach.

VMFII

Some of the most positive aspects of the Valid Metrics Framework are that it:

  • Provides a mechanism to link activities to outputs to outcomes
  • Tracks through the familiar sales funnel
  • Helps create a focus on outcomes.

One of the applications of the Valid Metrics Framework was for use with social media programs. Two potential issues were surfaced by early adopters of the framework in social programs. The intermediary effect, which in traditional public relations is the impact on the media, seemed at odds with the social world of direct interaction between consumers and brands, and consumers with each other. And use of the marketing sales funnel, while familiar, was only relevant in a percentage of social media use cases and perhaps not the best way to model common uses of social media like customer relations and building relationships with stakeholder groups. Also, thought leaders like Forrester Research and McKinsey & Company had noted the traditional communications funnel was not necessarily funnel-shaped in social media. They described the discovery process that occurs when investigating companies and brands that often cause the consideration set to expand rather than be reduced, and the fact that a lot of engagement around brands happens post-conversion event. For all of these reasons our task was develop and recommend a better framework and approach.

Models and Frameworks

When we use the word model, we are referring to a representation of a system, in this case social media. In the original Valid Metrics Framework, the model used was the traditional sales funnel. A framework adds additional dimensions to the model and is operationalized with metrics. In the Valid Metrics Framework the additional dimensions are the phases – activities, intermediary effects and target audience effects. We looked at both of these aspects individually and collectively when considering alternative approaches.

We studied and evaluated about fifteen different social media and communications models. A couple of common patterns emerged. Several of the models, including Forrester’s Customer Lifecycle and McKinsey’s Customer Journey showed a post-purchase engagement/experience step. We judged this important to include in our recommended approach. And we considered the importance of Engagement and Influence, as two key concepts in social media marketing and measurement, and decided to try to make these two elements explicit in our model as well.

Suggested Social Media Metrics Model

The model we developed is derivative of the categories chosen by The Conclave (Note: Richard Bagnall and I also participate in The Conclave) to organize social media metrics and definitions. We took a slightly different perspective on the front end of the model and reordered the back-end to create this model for our new framework. The descriptions of the stages use the definitions from the smmstandrards.org work wherever possible.

New Model

You will note Engagement includes both interactions with owned social channels as well as earned social conversation of people ‘talking about you’ in social channels. The definition of Influence is clear and concise, the result of a lot of discussion and prevailing clear thinking. The concept of Impact includes the outcomes of social initiatives as well as the Value those initiatives created. (I usually advise to always attempt to measure impact, and attribute value when it is feasible and makes sense.) Advocacy includes a very helpful definition and conditions that exist with advocacy.

Creating the Framework

To create the framework, we explored various ways to address the ‘phases’ of the Valid Metrics Framework. Two ideas stood out:

  • Use a simple structure that captures social media metrics from three key perspectives – programmatic-level, channel-specific and business. Programmatic metrics are those directly tied to social media objectives. Channel-specific metrics are just that, the metrics that are unique to specific social channels – tweets, RTs, Followers, Likes, Talking About This, Pins, Re-Pins. Business metrics are used to show the business impact of the campaign or initiative.
  • Use Paid, Owned, and Earned media metrics for integrated programs containing these elements. Borrowing the definitions from Forrester, Paid are social channels you pay to leverage (e.g. promoted tweets, display ads), Owned are channels you own and control (e.g. website, Facebook page) and Earned is where customers become the channel (e.g. WOM, viral)

There are certainly other ways to think about this (e.g. Business Performance Management) and we intend to possibly add others based on industry feedback and suggestions.

The AMEC Social Media Valid Framework

Currently we have developed both versions with sample metrics (taken from the smmstandards.org work where applicable). We are calling them The AMEC Social Media Valid Framework. Here is the version with Program, Channel and Business Metrics shown.

Valid Metrics Framwork

Where Do We Go From Here?

Look for the completed frameworks on the AMEC website shortly. We encourage you to adopt the frameworks for use by your company or clients. If you like them and find them useful, please help promote them widely. And please provide your feedback on the proposed framework on this blog, or through the social channel of your choice. We’re listening and looking forward to the dialogue.

12 Responses to “A New Framework for Social Media Metrics and Measurement”

  1. Richard Bagnall June 12, 2013 at 2:08 pm #

    Another great post as usual Don. This is a very good summary of the presentation last week at the AMEC European Summit (www.amecorg.com). The delegates there all fed back very positively afterwards. I’m looking forward now to seeing how the new framework pans out in action as organisations start to adopt and use it.

    Thank you for all of your help and hard work driving the PR industry on to think about how best to measure social media in ways that are meaningful and credible, yet also allow the vital component of flexibility.

  2. metricsman June 12, 2013 at 3:02 pm #

    Thanks, Richard, under your leadership I think we have done some good work.

  3. Angela Jeffrey June 12, 2013 at 9:02 pm #

    Don and Richard, congratulations on the revised frameworks for social media measurement. The timing is too funny given we just released my IPR white paper, “Social Media Measurement – A Step by Step Approach” which takes a deep dive into the original Valid Metrics Framework! Nevertheless, I welcome the revisions since they simplify the process. While my existing paper is full of how-to steps and tools, and will therefore still be of use, I definitely plan to revise the paper in several months with the new versions. Well done!

  4. metricsman June 13, 2013 at 2:24 pm #

    Thanks for stopping by, Angie. We’ll look forward to the revise – and sorry about the timing!

  5. Mattias Östmar June 14, 2013 at 2:31 am #

    Very impressive work!

  6. metricsman June 14, 2013 at 7:05 am #

    Thanks very much, Mattias. There is still a lot of work to do in gaining experience with the frameworks and in exploring possible framework variations. We do believe this is a good start and hope everyone finds them useful and effective.

  7. Philip Sheldrake (@Sheldrake) June 19, 2013 at 4:12 am #

    Hi Don, I’ve responded to your post over on my blog as you know. As a trackback hasn’t appeared here for some reason, here’s a link for anyone interested: http://eulr.co/12GTi5v

    Best wishes, Philip.

  8. Dallas June 27, 2013 at 1:14 am #

    Nice piece of work, it fits well with other models we are already using.
    One initial impression/criticism (not saying it is wrong, it just seems wrong intuitively, but it could just be a different perspective) is that the Impact events seem a bit weaker than the influence events.

    I’d almost put impact below influence on this scale.

    Just to use a simple physical metaphor, if something impacts something, it has an influence on it afterward. I guess in this sense you are talking about what impact the influence has (ie what effect the influence has)

    Probably all semantics… :-)

  9. reports April 8, 2014 at 10:36 pm #

    But, SMC P Ltd is one from the best among all the Visakhapatnam content writing companies. com) can expand its reputation and reach an audience much wider than you’d on your personal. http://tinyurl.com/lkurdol

Trackbacks/Pingbacks

  1. Download: Aligning Campaign Effectiveness and Content | B2B Voices - June 14, 2013

    […] Comments encouraged! New Post: A New Framework for Social Media Metrics & Measurement http://ow.ly/lXIn3 #MeasurePRt […]

  2. New Framework for Social Media Measurement – Update & Debate | - June 21, 2013

    […] I respect his opinion very much. Philip wrote a rather long essay on his blog in response to my original post on the new Valid Framework for Social Media. Richard Bagnall, Chairman of the Social Media […]

  3. Social media measurement, after Madrid | Philip Sheldrake - January 12, 2014

    […] landscape and presented their recommendations for a new framework at the AMEC summit. As Don writes in his accompanying blog post, their work seeks to answer the question: How do we take the standards work coming from The […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 157 other followers

%d bloggers like this: