Grand Final Punters On Twitter Make A Terrible Focus Group

Grand Final Punters On Twitter Make A Terrible Focus Group
SHARE
THIS



The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.

The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.

There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.

In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.

Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.

So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.

Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.

Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.

The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.

On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.

Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.

Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.

Latest News

THIS
  • Advertising
  • Marketing
  • Media

Meet Your Judges For The 2018 B&T Awards!

B&T is calling this year's awards judges probably the finest ever assembled. As a chamber choir, arguably less so.

by B&T Magazine

B&T Magazine
Indie Agency KWP! Snares Tourism NT’s Creative Account
  • Advertising

Indie Agency KWP! Snares Tourism NT’s Creative Account

Tourism NT has appointed KWP! as its lead strategic and creative agency. The independent agency, with offices in Darwin and Adelaide, has won the two-year contract following a competitive pitch in September this year. As the lead agency, KWP! is required to formulate sound strategic insights based on ongoing analysis of market research, consumer insights and […]

by B&T Magazine

B&T Magazine
McCann’s Action-Packed Army Ad Plays Out Like A War Flick Or Video Game
  • Campaigns

McCann’s Action-Packed Army Ad Plays Out Like A War Flick Or Video Game

Most army recruitment ads tend to steer clear of the blindingly obvious of military life – you get a gun to shoot the enemy or you get shot yourself. More so, agencies aren’t overly keen on promoting recruitment ads that are heavy on the guns or violence, preferring lifestyle or technical aspects of military life. Not so McCann’s new action-packed spot for the US […]

by B&T Magazine

B&T Magazine
Are You Dragging The Wrong People Into Pointless Meetings?
  • Opinion

Are You Dragging The Wrong People Into Pointless Meetings?

Donna McGeorge (pictured below) is a speaker and  mentor who helps people make their work work. McGeorge is also author of The 25-Minute Meeting: Half the Time, Double the Impact. In her latest guest post for B&T, McGeorge offers her tips on avoiding every workers’ hell- the pointless meeting… We all complain about having to attend too […]

Opinion

by B&T Magazine

B&T Magazine
Francis Leach Joins The New Daily As Sports Editor
  • Media

Francis Leach Joins The New Daily As Sports Editor

Famed sports reporter Francis Leach has joined online publisher The New Daily as sports editor. A prolific broadcaster, journalist and program host, Leach brings his encyclopedic knowledge of sport and no-holds-barred critical analysis to the role. “Let’s face it, sport these days is big business. I’m interested in connecting and contextualising sport with the big […]

AIME Appoints Eleven To Champion 2019 Vision
  • Advertising
  • Media

AIME Appoints Eleven To Champion 2019 Vision

Eleven has been appointed to manage all PR for the Asia Pacific Incentives Meetings & Event (AIME) 2019, the leading show for the business events industry. Selected by Talk2 Media & Events, Eleven will drive a global PR campaign, working with sister agency FleishmanHillard, to leverage international media networks across Asia Pacific, Europe, Middle East […]

Fox Sports Launches Alexa Skill
  • Media
  • Technology

Fox Sports Launches Alexa Skill

Australian sports fans can now tune into Fox Sports News live on their Amazon Echo device. From today, Alexa users will be able to add the new Fox Sports Alexa skill to their daily routine by asking “Alexa, play the Fox Sports live stream.” The Fox Sports Skill will deliver sports fans a live stream […]