What Happens When Chatbots Turn Racist

Man hands holding mobile phone on blurred urban city as background
SHARE
THIS



In 2016, Microsoft unveiled its social media chatbot ‘Tay’, tasked with engaging in light-hearted conversation with Twitter users around the world. Within 24 hours the bot had turned from a playful innovation to racist and misogynistic terror, spurting out a series of Donald Trump-esque tweets.

As the bot was simply engaging with and repeating posts it was seeing on Twitter, the question becomes, who’s fault is it when bots get it wrong?

This is now a pertinent question at a marketing level, with thousands of brands now using chatbots to automate and ultimately improve the experience of their customers.

“Ultimately the brand or the business is responsible for the customer experience,” said Bupa GM of digital growth Nick Blatt.

“If the customer has a bad experience with you [through a chatbot], they’re going to be brutal on you and your brand.”

In a recent survey of Australian business decision-makers, it was revealed that the most prominent internal concerns of businesses using AI systems such as chatbots was negative customer feedback or poor outcomes for certain groups of customers.

Fifth Quadrant research director Steve Nuttall, who helped conduct the survey, said that companies aren’t thinking about where they get their AI product from.

“The majority of people who are trialling or in the early implementation are not using their own AI, they’re not using locally based AI, they’re just taking it off the shelf,” he said.

And this is creating confusion when it comes to accountability of AI outcomes.

When asked whose responsibility it should be if something goes wrong with AI, half the survey respondents said the fault lies with the company that developed the system, while the other half said it is the responsibility of the company that deployed the AI.

Designing with ethics in mind

Despite fears of customer backlash, chatbots and automation now provide businesses with the unprecedented opportunity to reduce costs in customer service personnel, while simultaneously giving customers an improved and immediate service, particularly with simple enquiries.

But with the potential upside of the technology now so attractive, there is concern that businesses will simply look to implement it ASAP, rather than weighing up important ethical concerns.

Microsoft’s infamous bot is now three years old, and although the technology has improved significantly since, it is still far from perfect.

Just last year it was revealed Amazon had used an automated computer program to vet out job applicant’s resumes that gave preference to male applicants.

CEO and founder of international AI company LivePerson Rob LoCascio, said that diversity in the design process of these AI systems can create better outcomes.

“It’s a simple thing, bring in women, bring in people of colour, bring a diverse group in – even if they’re not technologists – just to look at this stuff and I think we can have a way to make this a fourth industrial revolution, versus an existential threat to humanity,” he said.

Please login with linkedin to comment

artificial intelligence Chatbot Ethics

Latest News

Acast Adds New Brand Suitability Controls For Advertisers Via Comscore
  • Advertising
  • Media

Acast Adds New Brand Suitability Controls For Advertisers Via Comscore

Acast, the independent power source of podcasting has teamed up with Comscore to provide brand suitability controls for brands advertising through the Acast Marketplace. This new innovation is part of a global partnership with Comscore, and will be available to all advertisers working with Acast Australia and New Zealand. The brand suitability solutions offered by […]

HubSpot To Support The GO Foundation As Part Of World Certification Week
  • Technology

HubSpot To Support The GO Foundation As Part Of World Certification Week

HubSpot, the customer relationship management (CRM) platform for scaling companies, has announced that as part of its World Certification Week, it is supporting the GO Foundation with its mission to empower young Aboriginal and Torres Strait Islander people through education. As part of the support, HubSpot will donate $5 for every HubSpot Academy certification awarded […]

IntelligenceBank Secures $50M Investment From Five Elms Capital
  • Technology

IntelligenceBank Secures $50M Investment From Five Elms Capital

IntelligenceBank has today announced a strategic growth investment from Five Elms Capital. The $US37 million ($50 million) investment comes as brands and enterprises have realised that outdated technologies, disjointed data sources, and manual processes make it challenging to efficiently manage essential marketing workflows and ensure compliance across the organization. IntelligenceBank digitally transforms manual processes and […]

SCA Announces Ten New Dab Music Stations Via LiSTNR
  • Media

SCA Announces Ten New Dab Music Stations Via LiSTNR

Southern Cross Austero (SCA) announced today 10 all-new DAB+ music stations on LiSTNr. The introduction of the 10 new Dab stations takes the number of music stations to 25 and reinforces its commitment to growing exclusive music programs and content. The 10 new stations have been created to cater to a variety of moods and […]

SBS Launches Live Interpreting Of Daily NSW COVID-19 Conferences In Vietnamese And Arabic
  • Media

SBS Launches Live Interpreting Of Daily NSW COVID-19 Conferences In Vietnamese And Arabic

SBS has launched live interpreting of the daily NSW Government COVID-19 press conference in languages other than English, to provide communities with access to the latest information and critical health messages. The national-first initiative provides real-time interpreting of the press conferences in Arabic and Vietnamese, streamed live every day on the SBS Arabic24 and SBS Vietnamese Facebook pages, SBS […]

Linktree Chooses Snowflake To Support Intelligence And Analytics Activities
  • Technology

Linktree Chooses Snowflake To Support Intelligence And Analytics Activities

Snowflake, the Data Cloud company, today announced it has been chosen by market-leading linking platform, Linktree, to support the company’s business intelligence and analytics activities. Linktree enables creators, brands, artists, publishers, agencies, and businesses of all sizes to curate an online ecosystem and monetise their passion, instantly guiding their audience to the destinations they care […]

London, UK - August 01, 2018: The buttons of Snapchat, Facebook, Instagram and WhatsApp on the screen of an iPhone.
  • Media

Snapchat Sees 116% Increase In Revenue

The last time B&T saw impressive increases the size of 116% was the swipe left rejections on our Tinder profile.

by B&T Magazine

B&T Magazine
Woman hand using modern laptop computer to connect with live streaming video on social network
  • Technology

Xandr Sees 125% Lift In Video Spend

Xandr, AT&T’s data-enabled technology platform at the intersection of digital and TV, today shared results of premium video, Connected TV (CTV) and curated media spend on its platform for Q2 2021, which saw significant increases.

Taboola Acquires Connexity For $1 Billion
  • Technology

Taboola Acquires Connexity For $1 Billion

Taboola (Nasdaq: TBLA), a global leader in powering recommendations for the open web, helping people discover things they may like, announced today that it has entered into a definitive purchase agreement to acquire Connexity from Symphony Technology Group for approximately $US800 million. Connexity is one of the largest independent e-commerce media platforms in the open web, serving over 1,600 direct merchants, and 6,000 publishers.

How To Re-Engineer Your Event Mix With ON24
  • Partner Content

How To Re-Engineer Your Event Mix With ON24

Events are increasingly shifting online. You can't get loaded on booze & arancinis, but you'll save on dry cleaning

by B&T Magazine

B&T Magazine
Twitter Lifts Revenue 74% On The Back Of Advertising Boom
  • Technology

Twitter Lifts Revenue 74% On The Back Of Advertising Boom

Twitter has just experienced its fastest growth in revenue since 2014, with the social media platform benefiting from increased interest from advertisers. Revenue was up 74 per cent YoY, according to the company’s Q2 results, reaching $US1.19 billion ($1.6 billion) from $US683.4 million ($925 million) 12 months ago. The strong results came in the same […]

by B&T Magazine

B&T Magazine
Wild Turkey Whisky Campaign Stars A Smouldering Matthew McConaughey
  • Advertising
  • Campaigns

Wild Turkey Whisky Campaign Stars A Smouldering Matthew McConaughey

Wild Turkey has announced the launch of its new global creative campaign and platform, ‘Trust Your Spirit’, featuring the brand’s creative director and spokesperson, Matthew McConaughey. The global campaign and platform ‘Trust Your Spirit’ is to encourage people to be bold, unapologetically themselves, and stay true to who they are. The global tagline and ethos […]

Optus Teams Up With TikTok To Launch Sign-Language Campaign
  • Marketing
  • Technology

Optus Teams Up With TikTok To Launch Sign-Language Campaign

Telecommunications company Optus has announced it will launch the world’s first TikTok sign-language activated filter. Featuring Optus ambassador Ian Thorpe, Optus will unveil a branded effect that shows TikTok users how to say key phrases in Auslan sign language, including ‘How are you?’ and ‘It starts with Yes’, through the hashtag challenge #SignYes. Optus will […]

Bapcor Debuts First Campaign With AJF
  • Campaigns

Bapcor Debuts First Campaign With AJF

Asia Pacific’s leading provider of vehicle parts, accessories, equipment, service and solutions, Bapcor will launch its latest campaign, ‘The unseen parts of every Australian journey’ this weekend.