Journalists Should Be Suspicious Of Our Results: Survey Monkey Boss

Newspapers on the computer keyboard close up

The US head of research at Survey Monkey agrees that journalists need to be as suspicious of stories and research drawn from its online surveys as they would be when handling any other story.

Jon Cohen, Survey Monkey’s vice president of survey research, agreed that people who used the platform to do “legitimate research” too often prejudiced the results with loaded or directed questions to a converted audience. He agreed that these “results” – often doled out to journalists as press releases with screaming headlines – can form the basis of articles that hold little journalistic worth.

JonCohenCrop_square1[1]

Cohen was in Australia recently presenting as Sydney’s Ad:Tech conference and admitted to B&T that a lot of groups and organisations that used its survey tools need to be better trained in how to do it.

“Anyone can put a survey up and get back data that’s completely inappropriate for what you meant to ask,” Cohen agreed. “We acknowledge that and we’re trying to put in guide posts to try and steer the user on how to write questions that don’t produce bias.”

Cohen admitted that journalists were increasingly publishing Survey Monkey results in articles without questioning the calibre of the findings as well as they should.

“All numbers are not created equal,” he said. “I’d certainly implore journalists to tick through when they encounter a number and they need to be just as sceptical as they are when they interview a person as they are when they see a number.”

What Survey Monkey was best at doing, Cohen said, was providing insights, and those insights could be used for a host of things including an agency’s creative process.

He said that agencies often sought external opinions only at the end of a six-month pitch when Survey Monkey could prove an invaluable tool throughout the process, particularly at the start.

“There’ll always be a natural tension between creatives and marketers and their bosses. And the tension is going to happen when it all comes from very diverse sectors, but I just think that conflict is much worse at the end,” Cohen said.

“It comes when there’s six months of work on the line, people’s jobs are on the line; you’ll always have conflict. But if you have the information throughout the process it (tensions) will be smaller and more contained and you can debate it and test and you’ll be fighting smaller fires than you will at the end,” he said.

This sort of data, Cohen said, can be valuable in getting existing work heading in the right direction or getting it started when you have no starting point at all. Survey Monkey didn’t necessarily give you the data required, rather the insights to get something up and moving.

“I don’t think anyone wants more numbers and this is why we keep bringing the debate back to insight,” he said. “Sometimes you can have so much data you can’t separate the signal from the noise. I think what we do have now is the capacity to collect this information in a structured way and then formalise and rationalise that process.

“You can have too much data, just as you can have too little. The idea is about asking the right question when the answer is going to be useful for the decisions you have to make,” he said.




Please login with linkedin to comment

Advertising Standards Bureau news.com.au Openpool

Latest News

It’s Friday Quiz Time Again!
  • Media

It’s Friday Quiz Time Again!

Take B&T's trivia quiz for your chance to win a $100 booze voucher and possible cirrhosis of a major internal organ.

by B&T Magazine

B&T Magazine
Big data technology and data science illustration. Data flow concept. Querying, analysing, visualizing complex information. Neural network for artificial intelligence. Data mining. Business analytics.
  • Marketing

SenateSHJ Launches New Trans-Tasman Practices

SenateSHJ has launched a new digital, data and insights capability designed to help clients tackle the growing complexity of communication challenges. SenateSHJ Digital, Data and Insights (DDI) will combine the firm’s existing Digital and Insights functions to create a Trans-Tasman capability focused on digital communication, and the generation and use of data to improve communication. […]

New BrandStory Format From Bonzai Allows 3x More Ad Space on Mobile
  • Media

New BrandStory Format From Bonzai Allows 3x More Ad Space on Mobile

Creative technology platform Bonzai has announced the launch of BrandStory – a new premium mobile ad format. BrandStory offers triple the ad space and 2.8 times greater time in view than single scroll ad formats, addressing the surging demand from brands worldwide for more real estate to drive real results by seamlessly intertwining awareness, exploration […]

B&T’s Search For Australia’s Greatest Ad Heads To Channel 7
  • Advertising

B&T’s Search For Australia’s Greatest Ad Heads To Channel 7

B&T went through the looking glass this morning, with editor-in-chief David Hovenden (above) appearing on Channel 7’s The Morning Show to get the general public involved in our search for Australia’s Greatest Ad. Hovenden chatted with Kylie Gillies and stand-in host Matt Doran about what makes a great ad and showcasing some of our favourites […]

by B&T Magazine

B&T Magazine
Opinion: The Tall Planner’s Kate Smither On The DBA Dilemma
  • Opinion

Opinion: The Tall Planner’s Kate Smither On The DBA Dilemma

The science is not in question – smarter people than I, with far more data, have codified it. The logic is not up for grabs…it makes sense that creating mental shortcuts to your brand keeps you at the top of your mind. Lead image: Kate Smither – Owner, The Tall Planner I wouldn’t even take […]

Opinion

by B&T Magazine

B&T Magazine
African woman using a cellphone in an office alone
  • Marketing

Ortto & Tall Bob Partner To Deliver Better SMS & MMS For Australian & NZ Businesses

Two Australian-born technology providers have joined forces to bring more power and choice to marketers in Australia and New Zealand with mobile messaging that is more local, cost-effective, and integrated. It’s a partnership that sees two Australian software companies come together to deliver a world-class mobile-first solution for marketers building data-driven, personalised, omnichannel campaigns. While […]

Slew Of New Hires At Snap Inc.
  • Media

Slew Of New Hires At Snap Inc.

Snap Inc. has announced a number of new recruits. B&T unaware if it positively impacted SEEK's share price.

Reddit Gets Playful Brand Refresh
  • Technology

Reddit Gets Playful Brand Refresh

This will be of interest to any Reddit fans, graphic designers or lovers of an orange so bright it burns the retinas.

Zitcha & Broadsign Partner To Drive Global In-Store Retail Media Market
  • Advertising

Zitcha & Broadsign Partner To Drive Global In-Store Retail Media Market

Zitcha and Broadsign have teamed up to integrate the Broadsign out-of-home (OOH) advertising platform with Zitcha’s retail media platform. The collaboration empowers retailers to maximise and monetise in-store digital display networks and enables advertising partners to easily view and book available in-store inventory and review campaign performance alongside the retailer’s other media channels. With the […]

Double Rainbouu & 7-Eleven Launch Exclusive Summer Fashion Label
  • Marketing

Double Rainbouu & 7-Eleven Launch Exclusive Summer Fashion Label

Today, 7-Eleven has announced a one-of-a-kind collaboration with the popular Sydney-based anti-resort wear label Double Rainbouu. Dropping tomorrow, December 1, just in time for summer, this limited-edition capsule will infuse the fashion brand’s rebellious spirit with a distinctly iconic 7-Eleven flavour. The unisex collection features five must-have styles comprising two signature Hawaiian shirts, a peaked cap, a bucket hat […]