Top 1 replica watches at

What Happens When Chatbots Turn Racist

Man hands holding mobile phone on blurred urban city as background

In 2016, Microsoft unveiled its social media chatbot ‘Tay’, tasked with engaging in light-hearted conversation with Twitter users around the world. Within 24 hours the bot had turned from a playful innovation to racist and misogynistic terror, spurting out a series of Donald Trump-esque tweets.

As the bot was simply engaging with and repeating posts it was seeing on Twitter, the question becomes, who’s fault is it when bots get it wrong?

This is now a pertinent question at a marketing level, with thousands of brands now using chatbots to automate and ultimately improve the experience of their customers.

“Ultimately the brand or the business is responsible for the customer experience,” said Bupa GM of digital growth Nick Blatt.

“If the customer has a bad experience with you [through a chatbot], they’re going to be brutal on you and your brand.”

In a recent survey of Australian business decision-makers, it was revealed that the most prominent internal concerns of businesses using AI systems such as chatbots was negative customer feedback or poor outcomes for certain groups of customers.

Fifth Quadrant research director Steve Nuttall, who helped conduct the survey, said that companies aren’t thinking about where they get their AI product from.

“The majority of people who are trialling or in the early implementation are not using their own AI, they’re not using locally based AI, they’re just taking it off the shelf,” he said.

And this is creating confusion when it comes to accountability of AI outcomes.

When asked whose responsibility it should be if something goes wrong with AI, half the survey respondents said the fault lies with the company that developed the system, while the other half said it is the responsibility of the company that deployed the AI.

Designing with ethics in mind

Despite fears of customer backlash, chatbots and automation now provide businesses with the unprecedented opportunity to reduce costs in customer service personnel, while simultaneously giving customers an improved and immediate service, particularly with simple enquiries.

But with the potential upside of the technology now so attractive, there is concern that businesses will simply look to implement it ASAP, rather than weighing up important ethical concerns.

Microsoft’s infamous bot is now three years old, and although the technology has improved significantly since, it is still far from perfect.

Just last year it was revealed Amazon had used an automated computer program to vet out job applicant’s resumes that gave preference to male applicants.

CEO and founder of international AI company LivePerson Rob LoCascio, said that diversity in the design process of these AI systems can create better outcomes.

“It’s a simple thing, bring in women, bring in people of colour, bring a diverse group in – even if they’re not technologists – just to look at this stuff and I think we can have a way to make this a fourth industrial revolution, versus an existential threat to humanity,” he said.

Please login with linkedin to comment

artificial intelligence Chatbot Ethics

Latest News

Brisbane Agency Colony Celebrates A String Of Client Wins & Growth
  • Marketing

Brisbane Agency Colony Celebrates A String Of Client Wins & Growth

A new player has arrived on the Brisbane scene – and it’s growing fast. Colony is a strategic communications advisory that started in Port Moresby in 2015, working with major Asia-Pacific clients like the Brian Bell Group, Digicel and Puma Energy. To build a greater capacity to support the Port Moresby office and serve these […]

Mitch Churi Moves Into ARN’s Evening Prime Time Spot
  • Media

Mitch Churi Moves Into ARN’s Evening Prime Time Spot

Mitch Churi has finally nabbed a prime time radio slot on KIIS after slogging it out on nights. Churi will now be taking over the airwaves on KIIS from 7-10 pm on weekdays. So you’ll be able to hear him discuss all things celebrity and pop culture while making dinner – what a vibe. Churi […]

AnalogFolk Group Launches A Behavioural Transformation Consultancy
  • Campaigns

AnalogFolk Group Launches A Behavioural Transformation Consultancy

AnalogFolk Group Launches Behavioural Transformation Consultancy, MindWorks Consulting. Focused on delivering improved business outcomes, the consultancy applies behavioural economics to both marketing strategy and organisational design. In a rapidly changing world, companies need to be nimbler than ever before, reading and reacting at pace to changing market conditions, competitor landscapes and customer needs. New technologies […]

Byron Cooke Announces Radio Return At Melbourne’s KIIS 101.1
  • Media

Byron Cooke Announces Radio Return At Melbourne’s KIIS 101.1

Beloved radio personality, Byron Cooke is back on Melbourne breakfast radio, announcing he will host KIIS 101.1 breakfast this morning and will back behind the mic until February when the Jase & Lauren in the Morning show returns. The announcement follows news regular breakfast co-host, Jase Hawkins, is expecting his third baby any day now. “I’ve been mates […]

Facebook Not High On Hemp Advertising
  • Advertising
  • Technology

Facebook Not High On Hemp Advertising

In what could prove bad news for the entire NSW far north coast region, Facebook's reportedly refusing hemp advertising.