The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.
The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.
There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.
In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.
Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.
So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.
Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.
Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.
The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.
On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.
Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.
Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.
Aussie retail payments platform Afterpay has launched a new global look, feel and positioning with a fresh brand identity. Founded out of Bondi, Sydney, Australia five years ago, Afterpay has skyrocketed to infinite heights, with almost 10 million customers and 55,000-plus merchants now using the platform globally across Australia, US, UK (where it is called […]
How Communications’ China marketing director, Doris Li, believes ad-land professionals must be courageous enough “to be abnormal”, and listen to their hearts, to be fearless in times of change. During this year’s B&T Women in Media Awards, presented by Bauer Media, we’ll be recognising exceptional people who have achieved success in their professional arenas, celebrating […]
The holding companies might be losing as much as 23 per cent of their revenue year-on-year, but new business has remained relatively resilient through 2020, the lastest research from R3 has revealed. In the first half of 2020 total new business revenue decreased 10 per cent globally – but creative agencies are having to find […]
Independent communications consultancy The Mint Partners has bolstered its integrated client roster and signed a number of premium lifestyle brands to kick start the new financial year. With an array of new products, services, and a focus on insight-led and creative integrated communications, MINT has enjoyed recent success with an expanded portfolio across new categories including fintech, […]
A feature length documentary on the extraordinary racing career of Australia’s first Formula 1 champion, Sir Jack Brabham, co-produced by design, animation and visual effects house Heckler, will be available on Stan exclusively from this Friday – 7 August. Directed by Ákos Armont (Aurora Films) in association with Heckler, whose co-founder Will Alexander served as […]
In a first for the Australian insurance market, Club Marine, Australia’s largest provider of boat and pleasure-craft insurance, has released a new series of videos to help explain insurance cover. With a few familiar Aussie personalities to help out, Club Marine is helping its members, as well as the broader boating community, to understand the […]