Grand Final Punters On Twitter Make A Terrible Focus Group

Grand Final Punters On Twitter Make A Terrible Focus Group
Thomas McGillick
By Thomas McGillick
SHARE
THIS



The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.

The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.

There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.

In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.

Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.

So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.

Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.

Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.

The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.

On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.

Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.

Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.

Please login with linkedin to comment

Adidas Mad Men Offline talkback The Bastion Group

Latest News

Hands using mobile payments, Digital marketing. Banking network. Online shopping and icon customer networking connection on virtual screen, Business technology concept
  • Media

IAS Report: Australian Digital Advertisers Experience Higher Brand Risks Across All Buying

Today, Integral Ad Science (IAS), a global leader in digital ad verification, released its Media Quality Report (MQR) for H2 2020, providing transparency into the performance and quality of Australian digital media, alongside global comparisons. Integral Ad Science’s H2 2020 MQR highlights brand safety, ad fraud, and viewability trends across display, video, mobile web, and […]

Quintis Appoints Illuminate As Global PR Partner
  • Media

Quintis Appoints Illuminate As Global PR Partner

Quintis Sandalwood has appointed Illuminate as its global PR partner following a competitive pitch process. Proudly Australian, Quintis produces and markets Indian Sandalwood oil, logs, chips and powder products across the world to major companies in industries such as fragrance, aromatherapy, cosmetics, handicrafts and Traditional Chinese Medicine industries. Illuminate will be responsible for a global communications […]

Image lead story Even More Pics From The 30 Under 30 Awards!
  • Media

Even More Pics From The 30 Under 30 Awards!

Hopefully the weekend has given everyone enough time to recover from B&T’s 30 Under 30 awards and prepare themselves for our official photo dump! We shared some of the highlights last week, and now you can peruse all of the pictures taken on the night. Thank you to everyone for attending this year’s awards, and […]

Recommended

by B&T Magazine

B&T Magazine
Kinderling Kids Streams Ahead With Direct-To-Consumer Offering
  • Marketing

Kinderling Kids Streams Ahead With Direct-To-Consumer Offering

Kinderling Kids Radio (Kinderling) has announced the completion of its move from DAB+, where it launched six years ago, to a direct-to-consumer streaming model, accessible online or through the Kinderling Kids iOS and Android app. The Parent Brand, the parent company of Kinderling Kids and Babyology, made the decision to shift as streaming and on-demand […]

RUN Take On The Flu
  • Advertising
  • Campaigns

RUN Take On The Flu

Globally award-winning, indie agency RUN, have launched the New Zealand National Influenza Immunization Campaign, running over the next 8 weeks across TV, digital, social, print and press.

Audika Says Stop Ignoring The ‘Whats’ And Get A Hearing Test, Via Ward6
  • Campaigns

Audika Says Stop Ignoring The ‘Whats’ And Get A Hearing Test, Via Ward6

Most people over 60 stay on top of their health with regular check-ups. Whether it’s eyes, prostate or breasts, they realise at their age it’s important. But one that gets ignored is hearing. They’d rather live with gradual hearing loss, and continually ask what, huh, pardon or sorry until it seriously impacts their life and […]

Connecting Plots To Handle [yellow tail] Social Media Following Account Win
  • Media
  • Technology

Connecting Plots To Handle [yellow tail] Social Media Following Account Win

Creative communications agency Connecting Plots has been appointed by Casella Family Brands to handle the social media accounts for [yellow tail] wine in Australia. The win follows an audit of the Casella Family Brands social activities, which led to [yellow tail] rethinking its approach to social media and how it aligns with its overall marketing […]

HERO’s B.B.E Wins v2food Account
  • Media

HERO’s B.B.E Wins v2food Account

v2food, has appointed HERO’s B.B.E as the lead strategic and creative agency for the brand following a competitive pitch process. v2food is an Australian pioneering food technology business with a global vision to feed the planet sustainably. After launching nationally in 2019, v2food has been on a mission to offer Australians an easy alternative to meat […]

Rows of coins isolated on white background. Finance and banking concept.
  • Media

Magnite And Adform See Monetisation Uplift Using First-Party Identifiers

Magnite (Nasdaq: MGNI), the largest independent sell-side advertising platform, today announced it has been working with Adform, the only independent global ad management platform covering all aspects of the digital campaign lifecycle, to scale first party identifiers in privacy-safe ways. With the pending elimination of third-party cookies, the industry must establish future-proof identity solutions for publishers and buyers.

Martin Box Named Co-Chair Of Commercial Producers Council
  • Media

Martin Box Named Co-Chair Of Commercial Producers Council

The Commercial Producers Council is delighted to announce the appointment of Martin Box (pictured) as its new Co-Chair, effective immediately. Box, Head of Production at Airbag, joins Co-Chair Pip Smart, and fills the vacancy left by Lucas Jenner who steps aside from the Co-Chair role after four years of service, in accordance with the CPC’s […]