Grand Final Punters On Twitter Make A Terrible Focus Group

Grand Final Punters On Twitter Make A Terrible Focus Group
SHARE
THIS



The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.

The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.

There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.

In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.

Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.

So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.

Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.

Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.

The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.

On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.

Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.

Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.

Please login with linkedin to comment

Latest News

Case Study: How Content Helped Tribal Marketing Come To Life Amongst Rev-Heads.
  • Opinion

Case Study: How Content Helped Tribal Marketing Come To Life Amongst Rev-Heads.

In this guest post, CEO of content marketing agency Edge, Fergus Stoddart (pictured below), says brands would do well to play on their customer’s loyal tribalism… Normally over Christmas, any downtime is spent asleep on the sofa, mildly lubricated with a belly full. This year, with the Ashes in the background, I managed to stay awake […]

Opinion

by B&T Magazine

B&T Magazine
Red Bull Holden Racing Team Unveils 2018 Cars On Sydney Harbour
  • Marketing

Red Bull Holden Racing Team Unveils 2018 Cars On Sydney Harbour

Red Bull Holden Racing team took the covers off its 2018 Holden Commodore Supercar today. Floating on a barge in Farm Cove, the harbour provided a stunning backdrop for the reveal. Teammates Jamie Whincup and Shane van Gisbergen have won the past two championships for the squad. Whincup, now the greatest of all time with seven Supercar’s titles, […]

Victorian Government Launches VR Bushfire Experience Via The Fuel Agency
  • Advertising
  • Campaigns
  • Technology

Victorian Government Launches VR Bushfire Experience Via The Fuel Agency

As part of its summer fire campaign, the Victorian government has launched a virtual reality (VR) bushfire experience and content series via The Fuel Agency. The VR experience places the user in the midst of a large bushfire, and is designed to encourage people to leave early on high-risk days before it’s too late. The […]

Local Ad Tech Company VeNA Partners With RugbyPass
  • Advertising
  • Media
  • Technology

Local Ad Tech Company VeNA Partners With RugbyPass

ad tech company VeNA has signed an exclusive reseller partnership covering Australia and New Zealand with digital rugby network RugbyPass. Across Asia and parts of Europe, RugbyPass is the exclusive digital rights holder and over-the-top broadcaster for live rugby, including the Super Rugby, the Rugby Championship and autumn internationals, the Six Nations, the Aviva Premiership, […]

SpotX Appoints Gavin Buxton As Asia MD
  • Advertising

SpotX Appoints Gavin Buxton As Asia MD

Video advertising platform SpotX has announced it has appointed Gavin Buxton as managing director of Asia to lead the company’s expansion in the region. Buxton has over 17 years’ global experience in the digital advertising space, having worked in leadership roles at tech and publishing companies, including Microsoft, Turner Broadcasting, and LinkedIn, with the last […]

Big Mobile Doubles Down On Ad Tech & Rebrands
  • Advertising
  • Technology

Big Mobile Doubles Down On Ad Tech & Rebrands

B&T Awards 2017 finalist Big Mobile has unveiled a fresh look to reflect its new ad tech credentials. The company successfully pivoted its business from ad network to mobile ad tech vendor when it announced a joint venture (JV) with Widespace in October last year. As a result of the business changes, Big Mobile wanted […]

March One Appoints New Senior Account Manager
  • Advertising

March One Appoints New Senior Account Manager

Independent ad agency March One has appointed a fresh face to the team, with Melanie Tozer to reinforce its mission to put humans first as a senior account manager. Tozer (pictured above), an up-and-coming talent from New Zealand, will align her extensive experience in FMCG marketing with March One, having worked on accounts for Bunnings […]