“Statistical Sirens Drowning Our Media Budgets (& My Will To Live)”
In this guest post, Duncan Jones (pictured below), digital strategy director at MediaCom Australia, says we’re an industry obsessed with numbers. But, he argues, the numbers can lie…
We bloody love a statistic in media.
As we guide clients through the sometimes murky waters of media, stats are like beacons reassuring everyone that we are on a sure course towards a ‘consumer connection’ – or so it would seem. As an industry, I think we need to understand exactly what these figures are telling us and how they have been reached, otherwise we’re in danger of falling victim to sirens who would lead our media dollars astray!
Only last week, I was sitting in a fascinating research presentation around how we should understand the true impact of video advertising. With stats being bounded around like, “Targeting increases ROI by up to 27 per cent” and “11 per cent increase in viewer attention when creative is concise”, I couldn’t help but find myself shuffling media dollars in my mind and preparing myself to preach to clients. This was all until I discovered the research was based on 60 people.
While there are undoubtedly lessons to be learnt in what the research says, the stats that come with them create an expectation. If I make this change, I will see that result too. I wish that was the case, but unfortunately the majority of times it just won’t be.
To continue to see past the percentages and stay on track, I would say there are three key questions we need to keep asking ourselves.
Who did the research?
Or perhaps more importantly – who’s funding it? There are essentially two ways that research funds itself (1) someone is paying for it as “sponsored research” or (2) people are paying to gain access to research reports which have been completed by third parties.
Now call me a cynic, but if someone is publishing results of sponsored research, it’s likely to tell a story they can profit from – yeah, you know who you are! In the instance where there aren’t independent third-parties such as Nielsen & Millward Brown involved to ensure an unbiased perspective, we’re at risk of accepting inflated results of people who have effectively marked their own homework.
Who were they asking?
In this instance, size isn’t everything, but for me it’s important!
For results to be viable, we need data sets which allow for statistical certainty – namely a confidence level of 95 per cent and margin of error of 5 per cent. The data set therefore needs to match the size and distribution of the large buying audiences it is often representing.
Beyond the geeky stuff, size intuitively tells me that the sample is inclusive, has depth and a diversity of opinion. It gives confidence that the results that are produced are not just a publishers mates telling them they’re great down the pub, but rather, they seek to encapsulate some kind of ‘realness’ of the audience they are prophesying for.
Too often stats based on a publishers specific or niche audience will be blown out to represent all Australians of a certain demographic, which in reality will not be the case. If inclusivity at scale can all be proved to exist, then I am ready to believe.
How were they asking?
‘Does my bum look big in this?’ will invariably lead to a 0 in 10 people agreeing with this, unless you want a slap!
There are too many instances where measurement is made too easy with self-fulfilling questioning or conditions. Take the trusty brand uplift study, which we all use to define success of our campaigns.
Asking, “Do you remember seeing an ad from brand X”, to me is the same as asking “Don’t think of an elephant”. By framing the question in a different way, the innocent formulaic nature of a brand effect can quite easily be twisted to produce a snappy ‘10 per cent uplift’ for a funder’s case study.
We need to check that the method and conditions of research are structured to allow the respondent to not be hamstrung. Instead, they need to be free to reveal their true ‘media-selves’ and only then can we take them as valid.
Three simple questions but unfortunately these probably won’t give you the answer – sorry. However, what asking these questions will do, is give us an understanding of the validity of statistics plonked in front of us on a daily basis.
At MediaCom, our specialist teams of Business Science and Data Insights are our first port of call and at the heart of our client and consumer understanding. By leveraging the understanding of first party data they create and overlaying this with robust industry statistics, it allows us to triangulate a truer course toward the ‘consumer’.
Latest News
Sydney Comedy Festival: Taking The City & Social Media By Storm
Sydney Comedy Festival 2024 is live and ready to rumble, showing the best of international and homegrown talent at a host of venues around town. As usual, it’s hot on the heels of its big sister, the giant that is the Melbourne International Comedy Festival, picking up some acts as they continue on their own […]
Global Marketers Descend For AANA’s RESET For Growth
The Australian Association of National Advertisers (AANA) has announced the final epic lineup of local and global marketing powerhouses for RESET for Growth 2024. Lead image: Josh Faulks, chief executive officer, AANA Back in 2000, a woman with no business experience opened her first juice bar in Adelaide. The idea was brilliantly simple: make healthy […]
Is Meta’s New AI Chatbot Too Left-Wing?
Meta's chatbot accused of being left-wing after being caught wearing a Che Guevara T-shirt & listening to Billy Bragg.
TV Ratings (23/04/2024): Why Did No One Tell Angela That Farmer Wants A Wife Is Set On A Farm?
As wonderful as this headline is, let's face it, we all know an 'Angela', don't we?
PubMatic Unveils New AI Partnership To Turn Social Posts Into Ads For Any Digital Channel
Here's some nifty tech for turning social posts into ads. Assuming said posts aren't one-star character assassinations.
Intuit Mailchimp Makes A Splash With Its First Australian Brand Campaign
Ever laugh along at a gag you didn't get so as not to appear dumb? Get ready for more feigning with this new work.
GumGum’s Rob Hall: Advertisers Can No Longer “Rely On Binary Descriptions” Of Consumers
If anyone's got their finger on adtech's pulse, it's Rob Hall. He also avoids using the good paper in the office printer
Mastercard Nabs Florencia Aimo From Marriott International
Marriott International's Florencia Aimo jumps from the hotel business to the exploitative credit card one.
Bastion Agency Appoints Cheuk Chiang As New ANZ CEO
Cheuk Chiang takes the reins over at Bastion Agency. But not the rains down in Africa.
Spotlight On Sponsors: Major Sponsorship Wins After A Disappointing Week In Sport
B&T continuing our deep dive into local sport sponsorships & that's despite not a single offer of a free ticket as yet.
Macca’s Marketing Director, Samantha McLeod On Big Mac Chant: “What Was Once Old Is Now Cool Again”
Macca's using the power of nostalgia in latest Big Mac campaign. Well, only for those who've ever eaten one sober.
World Premiere Of Midnight Oil: The Hardest Line To Open Sydney Film Festival 2024
Oil's biopic to open Sydney Film Festival. Here's hoping Molly Meldrum will take his pants down at the premiere.
Entries Are Now Open For The 2024 Brandies, IntelligenceBank’s Annual Brand Marketing Awards
The Brandies are, of course, a prestigious marketing gong and not the mystery tipple favoured by nannas everywhere.
The Fred Hollows Foundation Appoints Ardent For PR
Yes, we all like to have a joke at PR's expense. But sometimes it does important work, like this.
AI, eCommerce & Marketing Specialists Are In Increased Demand By Businesses, New Data From Fiverr Shows
Has your philosophy & anthropology degree left you with nothing but a huge HECS debt? Here's what you should've studied.
Perth’s First 3D Anamorphic Billboard Arrives Courtesy Of oOh!media
Do you love a buzzword? Now you can add anamorphic to the list as it relates to billboards, not a colleague's ears.
MasterChef Australia & Crown Resorts Launch Unique Dining Experience With ALUMNI
A pop-up restaurant staffed by MasterChef contestants! That's fine dining prices for first-year apprentice chef cuisine!
Amanda Laing Announces Resignation From Foxtel Group
Foxtel's chief commercial & content officer heads for the exits. Read nice things the bosses said about her right here.
The Lost Letters From Our Diggers: News Corp Unveils ANZAC Day Special
It's nice when brands respectfully acknowledge ANZAC Day.
Howatson+Company Acquires Akkomplice
Large indie acquires a slightly smaller indie. Much like a shark eating a tuna, just with less thrashing and blood.
Google Delays Third-Party Cookie Deprecation Again
In good news for the sale of picture library biscuit photos, Google continues to tease over the end of cookies.
Education A Low Priority For Aussies More Concerned With Cost Of Living Forethought Study Reveals
Study finds Aussies cutting back on education due to cost of living. Booze & Uber Eats sales remain largely unaffected.
“I’m Still The Same Person That I Was”: Rikki Stern Says “Fucc It” To Cancer Stereotypes
B&T always happy to promote the anti-cancer cause. Even brands that massively overdo it with the hot pink.
The Unapproved Climate Certification Allegedly Causing Mass Greenwashing
Are you left flummoxed in the canned tuna & free range eggs aisle? Just wait till this green certification gets up.
TV Ratings (22/04/2024): Fans Mock “Over The Top” Reaction To New MasterChef Judges
MasterChef returns for its 2024 season. B&T stands by putting peppercorns in Gravox & no one will be any the wiser.
Dentsu Restructure: Muddle, Harvey & Johnston Take Leadership Baton As Bass & Yurisich Exit
A large broom has swept through Dentsu's local ops this morning, taking with it some big names & the air con's cobwebs.
Industry Shares Trends Shaping The Industry This International Creators Day
B&T's asking adland creators to reveal their top trends. And it's not good news for your Jenny Kee cardigan collection.
Mable Extends HOYTS Sensory Screenings Partnership
Mable has extended its HOYTS sensory screening partnership. Vigorously defends its two-star Oppenheimer review.
Orphan Launches ‘They Need Our Help. We Need Yours’ For Children’s Cancer Institute
Anything to do with childhood cancers has B&T's 110% support. That said, we do ignore the red meat & alcohol warnings.
Smile Team Orthodontics & Keep Left Collaborate On Smile-Inducing Campaign
As parents would attest, given the cost of orthodontics you'd expect this campaign to be a lavish production indeed.
Opinion: How Video Calls Neglect Learning Diversity
Need an excuse to duck out of a video call this arvo? Show this to your boss.
DoubleVerify Achieves First-Of-Its-Kind Responsible AI Certification From TrustArc
DoubleVerify receives responsible AI certification. However, not its robotic vacuum that's been seen menacing the cat.
Smile For A Good Cause: The Social Media Campaign Giving Back To The Community
Are you known as the office Austin Powers? More for you teeth than shagability? Get snappy new fangs with this news.
Elon Musk Mocks Albo After ESafety Wins Court Injunction Against X
Albo's 2024 from hell continues - Rabbitohs in crisis, down in the polls and now feuding with world's richest man.
Real Estate Developer In Hot Water Over “Sexually Exploitative” OOH Campaign
Real estate agents again tops in the 'least trusted profession' polls, nudging used car salesmen & ad creatives.
Epsilon’s Shane Hanby: Post-Cookie Era Relies On “Teamwork” Between Brands, Marketers & Tech
This pro predicts more "teamwork" in a post-cookie era. Which spells bad news for the uncooperative or plain stubborn.