Grand Final Punters On Twitter Make A Terrible Focus Group
The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.
The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.
There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.
In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.
Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.
So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.
Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.
Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.
The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.
On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.
Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.
Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.
Latest News
History Has Arrived: It’s The Cairns Crocodiles Inaugural Shortlist
Pen the acceptance speech and ready your best thongs and muumuu, because the Cairns Crocodiles shortlist has arrived.
IAS Launches First-To-Market Integration With Roblox To Provide 3D Immersive Measurement
Integral Ad Science, a global media measurement and optimization platform, today announced a market integration with Roblox, a global immersive platform for connection and communication. Available for advertising campaigns on Roblox later this year, IAS’s Viewability and Invalid Traffic (IVT) Measurement products will provide advertisers increased transparency into the quality of their Immersive Ads within […]
Fast And Furious: Top Gear Australia Launch Thrilled Motorheads, Car Entusiasts And Guests
B&T is still no closer to knowing who the new Stig is, except that she is a woman and a ridiculously fast.
TV Ratings (02/05/2024): Seven’s The 1% Club Wins The Night
The 1% club did not live up to its name when it comes to TV ratings last night.
TRA Welcomes Raft Of New Hires; Bolstering Expertise Across Markets
Insights and research agency TRA announces slew of new hires. Still no news on the return of marble wash denim, however.
CX Lavender Hires Boston Consulting Group’s Kim Verbrugghe as Chief Strategy Officer
CX Lavender announces new strategy hire and channels 'acoustic folk act at local RSL' for the publicity pic.
Opinion: Community standards, will they be the death of us?
This columnist is talking community standards. Sadly not those people who put dogs in trolleys in supermarkets.
Tegel gets heads bobbing with new free-range chicken platform
Sure, there's a lot of moral considerations when buying a chook. Yet, not as baffling as buying eggs or canned tuna.
Study: 66% of Aussie men believe masculinity is under attack
Two-thirds of Aussie blokes say masculinity's under attack. That said, sales of Solo lemon drink appear robust.
‘Equal Writes’: Canyon reveals new campaign and refreshed brand for women and non-binary writers
As this brand redesign again proves, nothing beats black on white. Well, white on black in this instance.
Icon Agency bolsters consumer and integrated offer with major hires
Icon Agency unveils new recruits. As press photo confirms office moustache competition now a lay-down misère.
Clemenger launches agricultural graduate program
Has Farmer Wants A Wife triggered an interest in dagging & hay balers? This grads program may resonate.
Levi’s Appoint UM As Global Media Agency For $217m Account
Levi's are the jeans for rockstars, models & the cool kids. Although that's not stopped dads from ruining their image.
QMS Nabs Sean Rigby From oOh!media
Things set to get spicy at the next Outdoor Media Association dinner and dance as a rival gets poached.
Bumble Reveals New Brand Identity To Usher In New Era Of Dating
It's ironic that all the dating apps market themselves as having no weirdos, freaks or mummy's boys like their rivals.
Stay In The House From Up! Airbnb Introduces Icons
Airbnb is now letting people stay in "iconic" places that sadly doesn't include the house from Silence Of The Lambs.
Changing The Conversation: The Role Of Media In Ending Violence Against Women
Governments are finally waking up to the DV crisis. Here, B&T chats with Jasmin Bedir on the role media can play.
“If You Want To Listen To Something Else, Go For It”: Fifi Box On Blocking Out The Noise & Focussing On What Works
No one is at the coal face of Melbourne radio like Fifi Box. Here, she chats with B&T without coughing up a lung.
Spotlight On Sponsors: Ferrari Signs Landmark New Title Sponsor
B&T continuing our series on sports sponsorships. And, yet again, there's little good news for the ten pin bowlers.
Choose A Path Less Trodden This Cannes In Cairns
Not since Wonka opened the factory has there been such a hot ticket in town. Here's how to make the most of Cairns.
Cannes In Cairns MC Keeva Stratton Shares Her Top Session Picks
Quip boss calls out her highlights of the Cannes agenda. We're assuming B&T staff b-boy demonstration was an oversight.
Here Are The Agencies That Made AFR’s Best Places To Work List And What The Industry Can Learn From Them
Did your office not make the list? Make sure your boss shouts at least two schooners at office drinks come Friday.
Get Ready, B&T’s Best Of The Best Is Back With The Top Holding Company Executive Leaders – Creative!
Want to know who the Grandest of the Grand Poobahs in the industry are? Look no further than this exhaustive list.
How A Glittering Campaign Helped The Australian Museum Sell 400,000 Tickets
B&T thoroughly enjoyed the Ramses exhibition at The Australian Museum, despite thinking we were going to the Archibald.
TV Ratings (30/04/2024): A “Shoey” Straight From A Fish’s Mouth Launches The Cheap Seats Into 2024
Last night's TV saw horny farmers beat Lego nerds, who beat fame-obsessed home cooks, who beat a chap with a large fish.
Spotlight Extends Partnership With Starlight Children’s Foundation
B&T always happy to promote the excellent work of the Starlight Foundation. Less so the Starfish Fanciers Foundation.
Amazon’s Advertising Quarterly Revenue Soars To $11.8bn
There are so many Amazon couriers visiting B&T headquarters at the moment our office dog doesn't know who to maul first.
VML Wellington Welcomes Jacob McGregor As Pou Ārahi Māori
McGregor set to lead cultural competency and safety at VML Wellington in important new gig.
“They Grow Up So Fast”: Simon Fowler On Five Years Of ABEL
Abel's CEO talks lessons learned from the agency's first five years. Including staff nicking all the Nespresso capsules.
Kyle & Jackie O Urge Melbourne To Pick A Side
Who can stop Kyle & Jackie O's indelible march into Melbourne radio? Is Peter 'Moony' Moon waiting by the phone?
Future & Taika Waititi Feature In Striking New Global Belvedere Campaign
Not only does drinking vodka make you cool like these dudes, it also has great weight loss properties for the bone idle.
The Fall Of Bonza: A Case Study In How To, And Not To, React In A Crisis
Does the collapse of yet another budget airline hark back to a gentler time of 17 hours spent on a Greyhound bus?
Opinion: Agencies, Be Unique – Stop Using The Word “Unique!”
Trinity P3's Ellie Angell says agencies are overusing the word unique. You could add omnichannel & holisitic to that.
Ex Marketing & Advertising Exec Releases Melanoma Memoir
Ex-adlander Anne Gately has penned a tome to skin cancer. Which is a handy reminder to check your moles, people.
Mamamia Appoint Danni Wright As New Head Of Strategy
Danni Wright takes up Mamamia's strategy reins with a feng shui expert called over positioning of office chaise lounge.
From The Bureau: Championing Competency & Cross-Industry Collaboration
The IAB's Jonas Jaanimagi calls for more specialisation in adtech. Meaning you'll understand it less than you already do.