The US head of research at Survey Monkey agrees that journalists need to be as suspicious of stories and research drawn from its online surveys as they would be when handling any other story.
Jon Cohen, Survey Monkey’s vice president of survey research, agreed that people who used the platform to do “legitimate research” too often prejudiced the results with loaded or directed questions to a converted audience. He agreed that these “results” – often doled out to journalists as press releases with screaming headlines – can form the basis of articles that hold little journalistic worth.
Cohen was in Australia recently presenting as Sydney’s Ad:Tech conference and admitted to B&T that a lot of groups and organisations that used its survey tools need to be better trained in how to do it.
“Anyone can put a survey up and get back data that’s completely inappropriate for what you meant to ask,” Cohen agreed. “We acknowledge that and we’re trying to put in guide posts to try and steer the user on how to write questions that don’t produce bias.”
Cohen admitted that journalists were increasingly publishing Survey Monkey results in articles without questioning the calibre of the findings as well as they should.
“All numbers are not created equal,” he said. “I’d certainly implore journalists to tick through when they encounter a number and they need to be just as sceptical as they are when they interview a person as they are when they see a number.”
What Survey Monkey was best at doing, Cohen said, was providing insights, and those insights could be used for a host of things including an agency’s creative process.
He said that agencies often sought external opinions only at the end of a six-month pitch when Survey Monkey could prove an invaluable tool throughout the process, particularly at the start.
“There’ll always be a natural tension between creatives and marketers and their bosses. And the tension is going to happen when it all comes from very diverse sectors, but I just think that conflict is much worse at the end,” Cohen said.
“It comes when there’s six months of work on the line, people’s jobs are on the line; you’ll always have conflict. But if you have the information throughout the process it (tensions) will be smaller and more contained and you can debate it and test and you’ll be fighting smaller fires than you will at the end,” he said.
This sort of data, Cohen said, can be valuable in getting existing work heading in the right direction or getting it started when you have no starting point at all. Survey Monkey didn’t necessarily give you the data required, rather the insights to get something up and moving.
“I don’t think anyone wants more numbers and this is why we keep bringing the debate back to insight,” he said. “Sometimes you can have so much data you can’t separate the signal from the noise. I think what we do have now is the capacity to collect this information in a structured way and then formalise and rationalise that process.
“You can have too much data, just as you can have too little. The idea is about asking the right question when the answer is going to be useful for the decisions you have to make,” he said.
The Real Media Collective (TRMC), the Australian industry association representing the interests of companies in the paper, print, publishing/media and related distribution sectors across Australia, has challenged Coles Supermarkets for using the environment as a reason in its announcement today outlining its plans to cease sending catalogues to Australian homes from September. In the announcement, […]
Network 10 is set to undergo a massive restructure, leaving a number of high-profile journalists out of a job, including Kerri-Anne Kennerley, Natarsha Belling and Tim Bailey, B&T understands. As first reported on The Sydney Morning Herald, the restructure was announced to staff on Tuesday. As part of the restructuring, the presentation of the weekday […]
Alcohol & Drug Foundation (ADF) has launched a new national health campaign with Campaign Edge aiming to tackle COVID-19 drinking. Funded by the Australian Government, Break the Habit reveals that it takes only around 66 days to form a habit – roughly the same amount of time many Australians spent in lockdown. It’s a fact most Aussies are […]
Paul Roach (pictured below) is a business strategist and coach who has worked with hundreds of SMEs across many industries to supercharge their cashflow. Roach is also author of the book Smarter Business Stronger Cashflow. In this guest post, Roach gives his top tips when the cash taps start to be turned off… Cashflow is like […]
Sydney and Melbourne based PR, Talent & Digital agency One Daydream has extended its client portfolio to include alcohol. The category expansion comes as One Daydream joins the agency roster of Pernod Ricard, working on a project basis to manage strategic PR and digital campaigns. The global drinks group boasts one of the most comprehensive and prestigious […]
Commtract today expanded its marketing, advertising and digital offering in response to a growing number of CEOs outsourcing to ‘gig-workers’ amid COVID-19. According to new research, 40 per cent of Australian CEOs are planning on outsourcing to freelancers in the contingent workforce. Commtract, which launched in 2016, has more than 4,000 communications experts on its platform, and has already placed over 800 roles. […]