Grand Final Punters On Twitter Make A Terrible Focus Group

Grand Final Punters On Twitter Make A Terrible Focus Group
SHARE
THIS



The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.

The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.

There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.

In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.

Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.

So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.

Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.

Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.

The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.

On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.

Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.

Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.

Please login with linkedin to comment

Adidas Mad Men Offline talkback The Bastion Group

Latest News

Aussie Success Story Afterpay Unveils New Brand Identity
  • Marketing

Aussie Success Story Afterpay Unveils New Brand Identity

Aussie retail payments platform Afterpay has launched a new global look, feel and positioning with a fresh brand identity. Founded out of Bondi, Sydney, Australia five years ago, Afterpay has skyrocketed to infinite heights, with almost 10 million customers and 55,000-plus merchants now using the platform globally across Australia, US, UK (where it is called […]

Women in Media’s Doris Li: “Listen To Your Heart And Go For It, Then Settle For Extraordinary”
  • Media

Women in Media’s Doris Li: “Listen To Your Heart And Go For It, Then Settle For Extraordinary”

How Communications’ China marketing director, Doris Li, believes ad-land professionals must be courageous enough “to be abnormal”, and listen to their hearts, to be fearless in times of change. During this year’s B&T Women in Media Awards, presented by Bauer Media, we’ll be recognising exceptional people who have achieved success in their professional arenas, celebrating […]

by B&T Magazine

B&T Magazine
Study: New Business Wins Still Resilient, But Creative Finding It Tougher Going Than Media
  • Advertising
  • Media

Study: New Business Wins Still Resilient, But Creative Finding It Tougher Going Than Media

The holding companies might be losing as much as 23 per cent of their revenue year-on-year, but new business has remained relatively resilient through 2020, the lastest research from R3 has revealed. In the first half of 2020 total new business revenue decreased 10 per cent globally – but creative agencies are having to find […]

by B&T Magazine

B&T Magazine
I’m Not Loving ‘Karens’, For What They Highlight About Our Society
  • Opinion

I’m Not Loving ‘Karens’, For What They Highlight About Our Society

In this guest post, the CEO of PR/comms agency Extollo, Katy Denis, examines the social phenomenon of our time – the entitled ‘Karens’ amongst us & why they can be such a danger… Until last week, I had no idea who or what a “Karen” is. Thanks to (and I use that term very lightly, […]

Opinion

by B&T Magazine

B&T Magazine
The Mint Partners Wins Pernod Ricard, Cemoy & Little National
  • Advertising

The Mint Partners Wins Pernod Ricard, Cemoy & Little National

Independent communications consultancy The Mint Partners has bolstered its integrated client roster and signed a number of premium lifestyle brands to kick start the new financial year. With an array of new products, services, and a focus on insight-led and creative integrated communications, MINT has enjoyed recent success with an expanded portfolio across new categories including fintech, […]

opr Adds DocuSign To Client Roster
  • Media

opr Adds DocuSign To Client Roster

Sure, it might not be a Coke or a Qantas, but opr think this win significant enough to send well-meaning press release.

Stan Acquires Heckler Co-Produced Biopic On F1 champion Sir Jack Brabham
  • Media

Stan Acquires Heckler Co-Produced Biopic On F1 champion Sir Jack Brabham

A feature length documentary on the extraordinary racing career of Australia’s first Formula 1 champion, Sir Jack Brabham, co-produced by design, animation and visual effects house Heckler, will be available on Stan exclusively from this Friday – 7 August. Directed by Ákos Armont (Aurora Films) in association with Heckler, whose co-founder Will Alexander served as […]

Would TikTok Be Missed?
  • Opinion

Would TikTok Be Missed?

Columnist poses the question - would TikTok be missed? B&T says not as much as vanilla Paddle-Pops or Best Of Red Faces.

Opinion

by B&T Magazine

B&T Magazine
Jamie Whincup And A Host Of Aussie Personalities Star In Club Marine Series
  • Media

Jamie Whincup And A Host Of Aussie Personalities Star In Club Marine Series

In a first for the Australian insurance market, Club Marine, Australia’s largest provider of boat and pleasure-craft insurance, has released a new series of videos to help explain insurance cover. With a few familiar Aussie personalities to help out, Club Marine is helping its members, as well as the broader boating community, to understand the […]