Grand Final Punters On Twitter Make A Terrible Focus Group

Grand Final Punters On Twitter Make A Terrible Focus Group
SHARE
THIS



The football grand final predictions made by Twitter users are an example of why we should take consensus with a grain of salt when evaluating consumer research, says strategist Thomas McGillick.

The central assumption of the phenomenon known as the wisdom of the crowd is that the average of a group of independent predictions is likely to be more accurate than any randomly selected individual prediction. The bigger the crowd, the better the prediction. It’s part observable effect, part misleading heuristic, and it’s the reason we so rarely challenge consensus among respondents in consumer research.

There are plenty of reasons why a group of consumers might struggle to accurately determine the potential effectiveness of an advertisement, and some of them have been on show over the last two weeks, as the collective wisdom of Twitter repeatedly swung and missed when predicting the outcomes of both football grand finals.

In the Australian rules final we had an excellent opportunity for the wisdom of the crowd to work as it is supposed to. The large upset means that the collective wisdom in the crowd of predictions should be seen in (if not an accurate prediction) a more accurate, or moderate prediction than that made by a bookmaker. The opposite happened.

Collating every tweet appearing the hours leading up to the opening bounce hashtagged #AFLGF resulted in an average prediction erroneously in favour of the Swans, that predicted a larger winning margin than that predicted by the major online bookmakers. Twitter had the Swans by 15.5 and the bookies on average had the Swans by 10.5.

So the crowd was wrong, so were the bookies, but in an instance where you would expect the crowd to be more accurate, they were more wrong.

Not surprisingly, Twitter also got the first try scorer and man of the match predictions wrong.

Turning to the NRL grand final and we have another surprising result. Not an upset this time, but a larger winning margin than the bookies and tipsters predicted. In this case the twitter hive mind correctly picked the favourite (Souths) as the winner, but consensus was less clear. Twitter predicted a Rabbits victory by 5.1, while the bookies margin was an equally impossible 8.5. The actual margin was a much larger 24 points, so again, the crowd was less accurate than the bookies.

The mistakes these two groups made are actually typical of groups reaching consensus, and they happen in consumer research all the time. The AFL crowd reached a consensus that was too strong, and so their overconfidence in the Swans lead them to overestimate the score line.

On the other hand, the NRL crowd didn’t reach a strong consensus, and so they were more conservative in their prediction.

Ultimately what this means is, just because a group of people agree on something, doesn’t mean that what they agree on is correct.

Charles Bukowski has an entirely more eloquent take on the wisdom of the crowd.

Latest News

Daylight Agency Appoints Shelley Hammond As Director Of Agency Operations
  • Media

Daylight Agency Appoints Shelley Hammond As Director Of Agency Operations

The Daylight Agency’s significant growth has continued with the appointment of Shelley Hammond as Director of Agency Operations. Shelley is a leader in the global communications industry and brings vast experience following senior roles in major corporates as well as the agency environment. Shelley will be responsible for the commercial running of Daylight including client retention and […]

Host/Havas Takes Out Cannes Grand Prix With Palau Pledge
  • Advertising

Host/Havas Takes Out Cannes Grand Prix With Palau Pledge

Host/Havas has secured Australia’s first grand prix award at Cannes overnight, taking out the top gong for the direct lions with its work Palau Pledge. The work, which sees all visitors to the tiny island nation have their passport stamped with a pledge to be a good environmental citizen, which they must sign before entering […]

by B&T Magazine

B&T Magazine
Ridley Scott Unveils New Directors Showcase At Cannes
  • Media

Ridley Scott Unveils New Directors Showcase At Cannes

Curated this year by Ridley Scott, famed director of Alien, The Martian and other classics, The New Directors Showcase at Cannes is now in its 28th year. Acting as a platform for talented new directors to have their work premiered to a global audience, Scott took to the stage in front of a full house […]

by B&T Magazine

B&T Magazine
ANZ, PHD & JCDecaux Harness The Power Of Data
  • Advertising
  • Campaigns

ANZ, PHD & JCDecaux Harness The Power Of Data

ANZ and media agency PHD have partnered with JCDecaux to launch a unique campaign that harnesses the power of data across three cities incorporating actual tram, train and bus timetable information to align with the new ANZ App.

Report: Consumers Are Hitting Play On Mobile Video
  • Technology

Report: Consumers Are Hitting Play On Mobile Video

Ooyala survey finds media companies created and processed nearly three times as much video content in Q1 as Media Companies Created & Processed Nearly Three Times As Much Video Content in Q1 2018 vs. Q1 2017.

MercerBell Calls In Two New Data Hires
  • Marketing
  • Technology

MercerBell Calls In Two New Data Hires

Proving many photos shot on an iPhone so often come out washed-out and grainy comes this article's accompanying pic.

Intrepid Travel Go Back 30 Years, Posting Classified Adverts In Newspapers
  • Campaigns

Intrepid Travel Go Back 30 Years, Posting Classified Adverts In Newspapers

Intrepid Travel has gone back in time and is placing classified adverts for a new ‘mystery expedition’ to places that yet mapped by Google.  The adverts to be placed in Courier Mail, Herald Sun and Sunday Telegraph are calling for intrepid people to join a journey with “long travel days, intermittent electricity, no Wi-Fi, cold […]

Watching tv and using remote control
  • Advertising
  • Media

GroupM Investment Forecast For Australia: TV On The Rise As Digital Slips

GroupM has updated its 2018 ad investment forecasts and released its initial 2019 outlook. GroupM predicts $24B in net new advertising investment this year, the best annual increment since the bounce back from the global recession in 2010 when $26B was added to investment. GroupM estimates total advertising investment will grow by 4.5 per cent this year […]

Indigenous Campaign Deemed Too Controversial By APN Media To Run
  • Advertising
  • Campaigns

Indigenous Campaign Deemed Too Controversial By APN Media To Run

Aboriginal Victoria’s campaign in support of Australia’s first-ever treaty legislation, Deadly Questions, has been deemed too controversial to run by one of Australia’s leading outdoor media providers, APN Media. Online platform Deadly Questions provides a safe space for people to ask questions and have them answered by Aboriginal Victorians, to learn more about their cultures, […]

Introducing: YouTube Music Australia
  • Technology

Introducing: YouTube Music Australia

The wait is over! Starting today, YouTube Music is available to everyone in Australia, New Zealand, the U.S, Mexico and South Korea in addition to 12 new countries including Austria, Canada, Finland, France, Germany, Ireland, Italy, Norway, Russia, Spain, Sweden, and the United Kingdom. Now fans around the world can find more of the music […]

Will PR Finally Earn Its Stripes At Cannes This Year?
  • Opinion

Will PR Finally Earn Its Stripes At Cannes This Year?

In this guest post, Haystac’s national general manager, Jason Carnew (pictured below), says with all this talk of Cannes at this time of year, it’s a kindly reminder that the PR business needs to get its act together in terms of awards, work and judging… All eyes on are Cannes as some of the best […]

Opinion

by B&T Magazine

B&T Magazine
Ex-DDBer Unveils Designer Headscarves For Cancer Survivors
  • Campaigns

Ex-DDBer Unveils Designer Headscarves For Cancer Survivors

Two-times cancer survivor, Frankie Good Stuff Award Winner, ex-DDBer and founder of Bravery Co. Emily Somers has collaborated with a range of top-notch illustrators to produce Australia’s first range of designer headscarves for young cancer warriors. She is now crowdfunding $40,000 to produce the scarves and donate one to all the young women in their 20’s […]

New Advertising Platform Launches Down Under
  • Advertising

New Advertising Platform Launches Down Under

Following its massive success in Europe, Asia and the UAE, the Polishoe concept, which brings a high-demand shoe polish service and HD digital advertising platform together, has landed in Australia.

Women In Media Profile: Aimee Buchanan
  • Media

Women In Media Profile: Aimee Buchanan

No Women in Media series would be complete without the irrepressible Aimee Buchanan. Read all her pressibles here.

by B&T Magazine

B&T Magazine
Set for blue sky, different clouds icons, cloud shapes, labels, symbols, icons. Flat graphic vector elements
  • Technology

PubMatic Unveils Cloud for Publishers And Tech Companies

PubMatic has launched PubMatic Cloud for publishers and tech companies looking to implement and control their own programmatic technology. By accessing PubMatic’s technology, global infrastructure and demand connections on a platform-as-a-service (PaaS) basis, clients are able to achieve full transparency and achieve greater control over their programmatic monetization. As programmatic trading becomes mainstream, innovations such as […]

Women In Media Profile: Claudine Hall
  • Media

Women In Media Profile: Claudine Hall

The Women in Media Awards are back for 2018! To celebrate this wonderful fact, and to recognise some of the killer women in our industry, we’ve created a women in media series – and have profiled some pretty inspiring women so far. This week, we chat with Bauer Media head of trade marketing Claudine Hall. […]

by B&T Magazine

B&T Magazine
Cancer Council and Target Tradies Tackle On-The-Job Skin Cancer Risks
  • Campaigns

Cancer Council and Target Tradies Tackle On-The-Job Skin Cancer Risks

Workers on construction sites receive five to 10 times more UV exposure every year compared to indoor workers. Target Tradies and Cancer Council have announced the launch of a partnership to help educate Australian construction workers about the importance of being SunSmart at work. With evidence showing that outdoor workers receive five to 10 times […]