“Statistical Sirens Drowning Our Media Budgets (& My Will To Live)”
In this guest post, Duncan Jones (pictured below), digital strategy director at MediaCom Australia, says we’re an industry obsessed with numbers. But, he argues, the numbers can lie…
We bloody love a statistic in media.
As we guide clients through the sometimes murky waters of media, stats are like beacons reassuring everyone that we are on a sure course towards a ‘consumer connection’ – or so it would seem. As an industry, I think we need to understand exactly what these figures are telling us and how they have been reached, otherwise we’re in danger of falling victim to sirens who would lead our media dollars astray!
Only last week, I was sitting in a fascinating research presentation around how we should understand the true impact of video advertising. With stats being bounded around like, “Targeting increases ROI by up to 27 per cent” and “11 per cent increase in viewer attention when creative is concise”, I couldn’t help but find myself shuffling media dollars in my mind and preparing myself to preach to clients. This was all until I discovered the research was based on 60 people.
While there are undoubtedly lessons to be learnt in what the research says, the stats that come with them create an expectation. If I make this change, I will see that result too. I wish that was the case, but unfortunately the majority of times it just won’t be.
To continue to see past the percentages and stay on track, I would say there are three key questions we need to keep asking ourselves.
Who did the research?
Or perhaps more importantly – who’s funding it? There are essentially two ways that research funds itself (1) someone is paying for it as “sponsored research” or (2) people are paying to gain access to research reports which have been completed by third parties.
Now call me a cynic, but if someone is publishing results of sponsored research, it’s likely to tell a story they can profit from – yeah, you know who you are! In the instance where there aren’t independent third-parties such as Nielsen & Millward Brown involved to ensure an unbiased perspective, we’re at risk of accepting inflated results of people who have effectively marked their own homework.
Who were they asking?
In this instance, size isn’t everything, but for me it’s important!
For results to be viable, we need data sets which allow for statistical certainty – namely a confidence level of 95 per cent and margin of error of 5 per cent. The data set therefore needs to match the size and distribution of the large buying audiences it is often representing.
Beyond the geeky stuff, size intuitively tells me that the sample is inclusive, has depth and a diversity of opinion. It gives confidence that the results that are produced are not just a publishers mates telling them they’re great down the pub, but rather, they seek to encapsulate some kind of ‘realness’ of the audience they are prophesying for.
Too often stats based on a publishers specific or niche audience will be blown out to represent all Australians of a certain demographic, which in reality will not be the case. If inclusivity at scale can all be proved to exist, then I am ready to believe.
How were they asking?
‘Does my bum look big in this?’ will invariably lead to a 0 in 10 people agreeing with this, unless you want a slap!
There are too many instances where measurement is made too easy with self-fulfilling questioning or conditions. Take the trusty brand uplift study, which we all use to define success of our campaigns.
Asking, “Do you remember seeing an ad from brand X”, to me is the same as asking “Don’t think of an elephant”. By framing the question in a different way, the innocent formulaic nature of a brand effect can quite easily be twisted to produce a snappy ‘10 per cent uplift’ for a funder’s case study.
We need to check that the method and conditions of research are structured to allow the respondent to not be hamstrung. Instead, they need to be free to reveal their true ‘media-selves’ and only then can we take them as valid.
Three simple questions but unfortunately these probably won’t give you the answer – sorry. However, what asking these questions will do, is give us an understanding of the validity of statistics plonked in front of us on a daily basis.
At MediaCom, our specialist teams of Business Science and Data Insights are our first port of call and at the heart of our client and consumer understanding. By leveraging the understanding of first party data they create and overlaying this with robust industry statistics, it allows us to triangulate a truer course toward the ‘consumer’.
Latest News
The Mars Agency Announces Latest Findings Of Retail Media Report Card
The Mars Agency has developed a scorecard that assesses the capabilities of leading platforms across key criteria required to optimally plan, execute, and measure effective retail media programs. The scorecard aims To help brands efficiently evaluate their spending options across retail media networks in Australia (and New Zealand). With spending on retail media advertising in […]
‘It’s The Lesser Of Two Evils’ – NRL Eyes US Betting Market As Aussie Regulators Circle
US betting firms will be delighted by the circa 50,000 Americans who could soon watch the NRL on their favourite app.
A-League In Deep Discussions With New Partner To Keep Games On TV After Production Company Enters Administration
The A-League's insatiable appetite for scoring own goals continues.
TV Ratings (27/03/2024): Jungle Members At War Over Concealed Lipstick
A heated argument between two jungle members did the numbers for Ten last night, with I’m A Celeb obtaining a total national reach of 1,282,000. Fans were delighted as Candice Warner and influencer Skye Wheatley got into it over a stick of lipstick, leading Warner to dub the Instagram star “selfish.” Wheatley, best known for […]
Is The Australian Music Industry In Trouble? Inquiry Launched Following Splendour Cancellation
Earlier this week, an inquiry was launched into the challenges and opportunities currently facing the Australian live music industry in the wake of multiple festival cancellations. On 25 March 2024, the Minister for the Arts, the Hon. Tony Burke MP, asked the Committee on Communications and the Arts to inquire into and report on the […]
Liana Dubois, Leandro Perez, Aimee Buchanan & More Gather For Inaugural Compadres Leadership Event
Didn't get the invite? Perhaps you're not as important as you thought.
Cathay Captures The Unforgettable Thrill Of Cathay/HSBC Hong Kong Rugby Sevens, Via Publicis
Nobody does rugby like Hong Kong, apparently. Certainly nobody does it as badly as Australia.
Cocogun Nabs Christine Watts, Kirsty Reynolds & Shev Tan Bolstering Management & Creative Teams
Cocogun bolsters its team with new hires. Committed to purchasing a bigger sofa, too.
The Media Store’s Jacquie Alley & Sam Cousins Take The Plunge With Pro-Bono Work For Cure Cancer
B&T chats with The Media Store bosses about their great pro-bono work and sponsored swim.
Hawke’s Brewing Co. Taps Rocket Comms For PR Agency Following Competitive Pitch
We're expecting Rocket Comms productivity to crash in spectacular fashion following this win.
Spotlight On Sponsors: Patties Serves Up A Taste Of Home For Olympians & South Sydney Rabbitohs Recommit To Gambling Reform
While the Rabbitohs commits to gambling reform, B&T reckons the team should commit to a decent auto sponsor.
Google: “Inevitable” That Bad Actors Will Abuse Ads Platform As Advertiser Account Suspensions Double
Google maintains it's simply impossible for it to entirely stop bad people placing & paying for ads using its service.
Quantcast Expands APAC Sales Team With Appointment Of News Corp Account Manager
No pressure at all when you are appointed as a client success manager.
Publicis Sapient Tests Microsoft-Powered Gen AI Search Tool With Homes & Villas By Marriott Bonvoy
Given Gen AI's record for mangling stuff, B&T cannot see the problem with letting it decide your next holiday digs.
Volkswagen & DDB Group’s “Roo Badge” To Reduce Kangaroo Related Road Collisions
Watch out for RooBadge as Cannes Lions' most debated campaign this year.
Twilio Launches Unified Profiles & Agent Copilot Features To Boost Productivity & Engagement
Agent Copilot sounds like James Bond's less interesting cousin.
Reebok & Honda Among New Clients For onetwo agency
OneTwo finally lives up to its name with this double billing.
Ogilvy Report: Throw Out The Social Strategy Rule Book, The Rules Of The Past No Longer Apply
B&T was puzzled that all 'influencers' aren't, effectively, 'virtual', but here we are.
WhiteGREY & AKQA Merge In Australia, Lee Simpson Departs
Fortunately, the combined agencies aren't opting for a trite portmanteau for the new name.
Splendour In The Grass 2024 Music Festival Cancelled!
Music fans all over the country reportedly relieved they can pack away their rain coats and gumboots for another year.
TV Ratings (26/03/2024): “Fairy Bread, F***ing Disgusting”: Gordon Ramsay Slams Aussie Food In Food Stars Launch
Ramsay not one for mincing his words, even when it comes to minced meat pies.
Paramount+ International Boss Doubles Down On Aussie Content, Says Ad-Tier will Grow Audiences And Revenue
Good news as Paramount will not be binning I’m A Celebrity for re-runs of Frasier.
Brent Smart: Telstra Pushing For 50-50 Brand-Performance Split But Warns Numbers ‘Won’t Look Great’ Initially
The old brand vs performance debate continues. But here, Brent is firmly sitting on the fence.
Crowded House, Tones And I & Dom Dolla Win Big At The Shure Rolling Stone Music Awards
B&T staffer reports back with humdinger of a hangover & feeling seriously uncool after mixing with music types.
Opinion: Dyslexia “A Hidden Gem” For Brands & Agencies
Dyslexics offer underappreciated benefits in the corporate field, according to this op-ed.
David Jones Taps Criteo To Power Online Retail Media Arm
Want to see ads for things you probably can't afford? David Jones has got you covered with new retail media play.
oOh!media Sets Up Team To Target Business Audiences Across Airports & Offices
oOh! wants brands to harass you every minute of your next business trip.
QMS Launches Australian First DOOH & TV Partnership With Samba TV
Samba TV, of course, is not a channel dedicated to dancing. Much to our dismany.
Slew Of New Hires At Amplify
Four new faces join the Amplify offices. Team say desk scarcity becoming "acute".
Adobe Announces Content Authenticity Initiative Expansions To Counter Deep Fakes
Try as they might to enlighten them, we suspect Trump supporters will continue to watch and believe Fox News.
The PR Group Appoints TechCrunch Senior Reporter Catherine Shu As Director Of Content & Media
Catherine Shu makes the bold leap from journalism to PR. Says inevitable pay bump was "unrelated".
HERO Nabs Ebony Santin From AMPR
Rumours Santin cleared out the stationery cupboard before departing are as yet unconfirmed.
Karena Noble Checks Out Of EVT Hotels & Resorts To Launch Comms Consultancy
Noble still managed to squeezed in a continental breakfast before departing.
Canva Acquires Design Platform Affinity To Bring Professional Design Tools To Every Organisation
Canva & Adobe face off continues. We're not picking sides but keenly aware that Canva's office is next door to ours.
“Lean On Our Team To Help You Find An Audience”: Why Understanding Audience Engagement Is Essential In Journalism
Engaging the audience is critical to journos, apparently. We'd thought self-loathing & alcoholism were key.
Adobe Summit: Major Gen AI Developments, Data Concessions & Partnerships
What happens in Vegas stays there. Unless it's the Adobe Summit and then you get to read about in B&T.