I'm a web strategist and aspiring know-it-all with a passion for all things digital. I've worked in PR, advertising and not-for profit industries, and now I run a creative agency. These are the things I think about, and am sometimes compelled to write. More...

The meaning behind the measurement

Sitting at a conference a couple of weeks ago, I sat in stunned silence as a member of a panel on gaming and engagement suggested that if interactive, gaming and social media wanted to grow its slice of the advertising pie, we would have to learn how to measure in terms of CPM.  On the surface, it sounds like a reasonable proposal – after all, a unified system of measurement for advertising can only help us all compare and evaluate results.

The problem, of course, is that there can be no truly unified measurement between radically different systems any more than you can measure the distance between New York and Vancouver in kilograms.  This is not a weakness of either the tactic, its measurability or the understanding of the medium, but rather a weakness in the desire to do things the way we’ve always done them.

Traditional media is measured very simply.  An advertiser buys reach and frequency based on the distribution of a particular medium, for a price ususally expressed in cost per thousand.  Whether the medium is newspaper, television or radio, there is a relative assurance that the advertiser will receive the number of impressions that they have paid for, and the value of those impressions is based on the value of the eyeballs it will be supposedly reaching.   The key thing here is that regardless of the medium, there is always a comparative metric and a comparative value.

When the web was still in its infancy, still being formed by the collective fingers of its users, advertisers co-opted this new medium in very much the same way.  If you wanted the eyeballs of Yahoo! users, you bought impressions based on CPM.  But as the way we used the web became more complex, and the technology and infrastructure that supported it became much more sophisticated,  it became impractical to reach people through a traditional broadcast approach.

So, the good agencies and strategists looked at how people were using the web, and eventually changed the way they thought about marketing to people online.  The problem is that the way we think about evaluation and measurement has largely remained rooted to the past, ignoring the realities of human interaction and attempting to retrofit social interaction with reach and frequency, or worse – attempting to express a complex interaction on par with a casual glance at a display ad in a newspaper.  The problem with this, of course, was that the measurement was left in the hand of those who were selling the advertising space.  What resulted was the baffling notion that 2.5 people read a newspaper cover to cover, or that 20,000 Neilsen families that nobody has ever met decide who’s watching what based on what they watch for a minimum of 2 minutes.  Understandably, when new marketers, who were measured not by guaranteed placement, but by human behaviour had to compare results, they couldn’t stack up side-by-side.

The challenge for new marketers is not measurement – any interactive medium offers no shortage of things to measure.  The challenge will be to move an entire industry away from its desire for comparing apples to oranges and establishing new benchmarks for success that do not rely on comparison to an irrelevant and inherently flawed system that is clung to simply because it’s the way things have always been done.  In order to do that, we need more case studies like Direct2Dell or Fiskateers, which may not have measured up in terms of CPM, but did more for a brand and for the bottom line than any print ad could have.

  • http://www.measuresofsuccess.com Katie Delahaye Paine

    You are SO right and brilliantly put. thank you thank you. thank you. Now I’ll measure the success of this posting in converts. :)

  • http://www.brainsonfire.com/blog Spike Jones

    Thanks for the kind words about the Fiskateer movement, Ryan. You’re right, if we got measured on CPM, then I don’t know if it would be deemed a success or failure. But as for many, many other elements, including the bottom line, it’s a huge success.

    Great post.

  • http://blogs.hillandknowlton.com/blogs/brendanhodgson Brendan

    Amen brother… particularly, when you look at audiences in segments like gaming who interact with brands in completely unique ways.

  • http://www.ryananderson.ca Ryan

    Thanks for the comments, all. I’m going to be at another interactive conference tomorrow, so I have my fingers crossed that the take on measurement will be a little more sophisticated.

  • http://mickeleh.blogspot.com Michael Markman

    It’s well and good to say that CPM doesn’t apply to various new media environments and engagements. But if your objective is to nudge marketers so they’ll shift their budgets from old media to new, then you’ll need to give them something they can compare to.

    The problem they want to solve is this: How do I get the most bang for my buck?

    If it ain’t CPM, what is it?

  • http://www.ryananderson.ca Ryan

    Michael – you’re right… we do need to provide a frame of reference, but it can’t be CPM, because it doesn’t tell you anything more than how much you spent to potentially get your message seen by someone. When you’re dealing with passive advertising like television, print or banners, that’s fine, but when you compare it to more complex community relations programs or heavy interactive, there’s no comparison.

    How many views of a television spot equal one engaged and evangelical customer who is willing to help you improve a product and tell people about it? 100? 1000? I really don’t know, to be honest.

    In that respect, it’s closer to cost per acquisition, but even that doesn’t equate completely. I’m not saying that we shouldn’t measure new media – quite the opposite. What I’m saying is that if we’re trying to compare marketing that generates deeply involved consumers to – let’s face it – unmeasurable traditional media, you’re doing both yourself and your client a disservice by letting them think that nothing has changed.