Tag Archives: media

The Margin Of Error

One bit of my old life as a broadcaster that I seem unable to leave behind is the ratings. TV ratings – and specifically those from Nielsen – are the currency of the TV ad business and billions of dollars of media are bought and sold based on these numbers. What caught my eye this morning was the reporting of last week’s late night ratings and the analysis connected to the report. The writer did a good job dissecting the numbers except that they conveniently failed to mention one thing that should be instructive to any of us in business: the margin of error.

English: Graph showing weekly Nielsen Ratings ...

(Photo credit: Wikipedia)

What the author failed to mention is that there was no statistical significance between the reported audiences in any of the numbers that Nielsen was reporting. Since the numbers discussed in the piece were Adult 18-49 numbers, the reporting is based on a subsample of Nielsen’s panel, meaning that the margin of error is wider than on all the ratings as a whole. While I don’t have a rating book in front of me, I know there always used to be a disclaimer in every book explaining that the numbers it contains are only accurate up to a point. They’re estimates. When we’re looking at number this small (and the late-night numbers are in tenths of a point), it’s just as possible that the network reported in third place could, in fact, have more viewers than the network reported as in first place.

The point here isn’t to denigrate the ratings system (I’ll save that for another screed). The point is to remind each of us that almost every piece of data that we look at needs to be taken in context and with appropriate disclaimers. What I find helpful is to pay attention to trends and not to absolutes. The only numbers without a margin of error are those pertaining to actual money received and actual money spent, and even those are generally only snapshots of a moment in time.

The next time someone comes to you with a data point, ask about the margin of error or about any factors that could affect that data. New visitors to your website are up? What percentage of people routinely delete cookies and, therefore, seem to be new when they’re not. App installs are up? How many people deleted the app last week, was that an increase, and could the new installs, in fact, be reinstalls? See what I mean?

Leave a comment

Filed under Consulting, Helpful Hints

How To Cure A Headache

My introduction to the business side of media came when I was a teenager. My dad was a television rep who sold time to ad agencies. Broadcasting Magazine showed up every week and once in a while, he’d have a Nielsen book in his briefcase for me to peruse. From my perspective, the business seemed pretty simple. The seller and buyer agreed on a price based on how many people they thought might be watching and how narrowly defined the parameters were with respect to when the ad could run. In other words, they negotiated and measured based on ratings, rate, and rotation.

Drawing "THE CLUSTER HEADACHE" Subti...

(Photo credit: Wikipedia)

When I actually followed my father into the media business, not much had changed. Sure, the numbers were more demographically-based instead of on household counts, but the business was pretty much the 3 R’s. Not anymore. In fact, a recent study by ID Comms found that most advertisers see media as a complex headache. It is pretty overwhelming now, both from the perspective of available media options as well as the addition of digital channels such as social media. The fact that a huge percentage of media is now bought programmatically through systems that are often rife with fraud and lacking in transparency adds to the headache.

I don’t think it’s the complexity of the media world that’s causing the headache. I think it’s a misplaced emphasis on buying efficiency at the expense of both strategic thinking and measuring results on things other than easily-manipulated metrics such as CPM. If a campaign makes the cash register ring, it’s effective. If it doesn’t, what good is it to have delivered something useless in a highly-efficient manner?

I’ve spoken with friends on both the sales and buying side of the equation. There seems to be universal frustration but not much in the way of solutions. It really needs to come from the people who control the purses – the clients. They need to stop thinking about CPM’s as a measure of efficiency (at least when it comes to digital, anyway) and place a lot more emphasis on strategy. Is the register ringing? Is the phone? Are there more interactions on social even if the number of “likes” isn’t rising? Is there a buzz about your brand? Those are the modern metrics that are relevant in the long-term and that kind of thinking can cure a media headache many folks are now experiencing. You agree?

Leave a comment

Filed under Consulting, digital media, Thinking Aloud

Smoke And Mirrors

I wrote last week about magic and distractions. Another magically-themed post today about the smoke and mirrors magicians use in their acts. That expression has come to mean something that’s deceptive or fraudulent, and a couple of pieces about the marketing business got me thinking about that term today. Even if you’re not a marketer (but who isn’t!), there’s something to take away.

One piece on Digiday dealt with ad-buying technology. You’re probably aware that the majority of digital ad buying (which will soon cover TV as well!) is done programmatically. No humans are involved other than to create the platforms on the vending end and choosing the ones to use on the buying end. The Digiday piece contains the following statements from an ad tech software developer:

I can say from first-hand experience that a lot of it is taped together stuff and nowhere near the sophistication that’s talked about…It is really easy to put up a website and mention “algorithms,” “machine learning” and a bunch of buzzwords. Nobody knows how that works. You can’t actually look into it, it is all just black boxes. But underneath, there is no real special sauce for a lot of these companies.

In other words, smoke and mirrors. Billions of dollars are spent this way and marketers are (finally) demanding to know how their money is really being spent. They’re turning on the lights and blowing away the smoke. Which leads to the second piece from MediaPost. It mentions “the terrible murky waters of rebates and contracts” and the same lack of transparency to which the other piece alludes. P&G is demanding more transparency, insisting that media agencies show that they are using providers that apply industry standards in measuring viewability and fraud. Ogilvy and Mather is reorganizing under a single P&L accounting structures for clients and thereby boosting transparency. Both of these moves are sending the magicians home.

We all need to ask ourselves about smoke and mirrors in our businesses. We need to challenge sources behind reports and assure ourselves that what we’re reading or hearing is rooted in fact and not someone’s fiction. A good practice outside of business too, don’t you think?

Leave a comment

Filed under Huh?, What's Going On