The Unconscious Bias In Facebook’s Moderation Problem

The Unconscious Bias In Facebook’s Moderation Problem
SHARE
THIS



Following the recent leak of Facebook’s moderation practices, online community expert, Venessa Paech (pictured below), covers the myriad challenges for the platform, and where to next for Facebook and its users in this guest post for B&T…

Facebook’s moderation practices are in the news yet again, as more detail of their playbook was leaked to the public (aka, their users) recently. They highlight alarming inconsistencies and a disdain for duty of care. But they also illuminate the bias at the heart of the problem.

Venessa Paech%5b1%5d%5b1%5d

Technology isn’t neutral. Like any other tool, it’s imbued with the assumptions, expectations, politics and predilections of those who create it. It’s shaped by the experience and perspectives those doing the tooling have lived up to that moment. We’re getting better at recognising and responsibly managing unconscious bias in our businesses and organisations. But we’re pretty ordinary at calling it out when it comes to social networks that feature prominently in our daily lives.

The standard push-back to more responsible content and user regulation on Facebook is concern over censorship (driven primarily by a nativist US perspective). This is, of course, a straw man argument. Facebook policies and positions already ‘censor’. Terms of service prohibit certain behaviours and activities. This is the beginning of curating a culture – at the margins.

When Facebook moderators remove a personal picture of a mother breastfeeding, but not a graphic rape or death threat, they’re making choices and creating cultural norms. These interventions are based on an explicit world view and legal lens particular to a small portion of actual users. They don’t consider community context and they ignore the fact they’re already a form of ‘censorship’.

When someone is intimidated or threatened out of participation, censorship is in effect. Women and other institutionalised marginalised groups are routinely drummed out of the virtual room by armies of trolls, men’s rights activists or the loudest hater in the room at any given moment. For some it’s a matter of life and death, where speaking up or speaking out provokes the ultimate attempt to silence – doxing (posting personally identifiable details like address or phone number, with the invitation to harass or stalk that person).

Facebook reporting tools, though better than they once were, still suffer from an either/or, square peg/round-hole problem, with inadequate categories to accommodate the thrilling range of abuse directed at women on the platform. And of course there are the all-too-common cases of people in crisis, (again, usually women), seeking the connectivity and support of their personal social network, but needing to cloak their identity and online activity from abusive parties.

Facebook will tell you repeatedly that they are committed to improving their content reporting capabilities, making it ‘easier’ and ‘faster’ to raise alarm. But reports are still in relation to Facebook’s ‘standards’, and it’s there that unconscious bias needs tackling first. By prioritising profit over harm minimisation, by intentionally refusing to use available technology to quarantine graphic content, and by ignoring their wider unconscious bias, Facebook is complicit.

Twitter founder Evan Williams recently issued a sincere mea culpa for what he now understands as Twitter’s role in mobilising toxic behaviour. I like and admire Evan, but was surprised at the naiveté of his comment: “I thought once everyone could speak freely and exchange information and ideas, the world was automatically going to be a better place. I was wrong about that.” I’m pretty sure most women (and other institutionally marginalised voices) would have had a safe bet what was in store; and some suggestions about better tools to help manage it.

Facebook has taken positive steps to scrutinise and address employer-side unconscious bias. But this doesn’t yet filter through to the platform itself. A diversity of perspectives in the room allows Facebook to more accurately map risk scenarios and desired user journeys. How many women or people of colour were involved when their now infamous moderation playbook was created? How many did they run it by to see if it tracked with lived experience? Were there anthropologists and ethnographers working alongside the lawyers? Diversity makes better products. It also makes safer, more equitable ones. Lessons from community management and the world of social science teach us that when people feel they can disclose without threat, they’re more likely to (ironically, revealing the kind of intimate data Facebook transforms into product, currency and share price).

Social and community professionals manage millions of groups across their platform, not to mention the ‘accidental’ community managers who voluntarily administrate local groups and communities of interest. One way to help scale the mountain of moderation is to engage these people in the creation of tools to manage and create a group culture that reflects their values and their needs. There are signs Facebook is starting to address this, with a ‘Communities Summit’ in Chicago connecting group admins with Facebook staff (including Zuckerberg himself). However, there is a rigorous application process and, for now at least, it’s only open to U.S admins. We watch with interest to see if the conversation is about ‘getting more out of Facebook’, or listening to community management needs with an intent to act.

Imagine where we might be if this decade-old business had engaged community experts and others outside its filter bubble to begin with? Imagine what a commitment to transparency could accomplish on all sides?

Venessa Paech is the Co-Founder of Swarm, Australia’s premier community management conference. Tickets now on sale at www.swarmconference.com.au

 

Please login with linkedin to comment

Latest News

Female Industry Leaders To Help Launch Unique Walking Tribe In Melbourne
  • Advertising
  • Marketing

Female Industry Leaders To Help Launch Unique Walking Tribe In Melbourne

After successfully launching in Sydney and Brisbane in the past year, Mentor Walks has announced it is expanding to Melbourne with the help of some female industry leaders. How Mentor Walks works is through a small group of senior female executive leaders who agree that, when they are available, will be part of a monthly […]

App Annie Announces New Managing Director For APAC
  • Technology

App Annie Announces New Managing Director For APAC

App market data and analytics company App Annie has announced the appointment of Cindy Deng as its new managing director for the Asia-Pacific (APAC) region. Deng joins App Annie with more than 18 years’ experience in enterprise IT, digital advertising, data analytics, and data management. In her most recent role at Turn, she was responsible […]

New Editor For GQ Australia
  • Media

New Editor For GQ Australia

Unfortunately, it's no more Lowes or Roger David for Michael Christensen after being named fashion organ's top tamale.

QMS Goes West With ‘The Leeder’
  • Advertising
  • Media

QMS Goes West With ‘The Leeder’

QMS Media continues to expand its digital portfolio across Western Australia, switching on an iconic billboard in the heart of Perth. Following the launch of two new digital billboards in the major WA regional centres of Bunbury and Kalgoorlie in recent months, ‘The Leeder’ further delivers on QMS’ digital expansion strategy out west. Positioned at […]

PR Firm Text100 Wins NetApp Account For APAC
  • Marketing

PR Firm Text100 Wins NetApp Account For APAC

Global marketing communications agency Text100 has announced it been appointed by data management company NetApp to drive its brand transformation effort across the Asia-Pacific (APAC) region. Following local competitive pitches conducted across the region, Text100 has been appointed as the APAC lead agency out of Singapore, and as the local agency of record in Australia, […]

MFA Awards 2017 Winners Revealed!
  • Advertising
  • Marketing
  • Media

MFA Awards 2017 Winners Revealed!

B&T once again donned the tux, applied the Brut, and primed the liver for last night's MFA Awards in Sydney.

Concrete Playground Launches Voice-activated Nightlife Guide With Google Assistant
  • Media
  • Technology

Concrete Playground Launches Voice-activated Nightlife Guide With Google Assistant

Digital publisher Concrete Playground has unveiled a new app that helps Millennials plan their night out using voice control – the first of its kind to become available in Australia. Concrete Playground’s Guide to Tonight now works with Google Assistant, making it available on a range of Google devices and helping people to decide what […]

Digital Agency Inlight Secures Two Key Client Wins
  • Marketing
  • Technology

Digital Agency Inlight Secures Two Key Client Wins

Independent agency Inlight has announced it has won the digital account for Benetas, a not-for-profit aged care provider in Victoria. Following a competitive pitch process, Inlight was chosen to handle Benetas’ new website design, build and ongoing optimisation. Richard Barker, marketing manager at Benetas, said: “We wanted an agency that could be our true digital […]

AMI Awards 2017 Winners Revealed!
  • Marketing

AMI Awards 2017 Winners Revealed!

With almost 30 awards handed out, B&T predicts plenty of numb bottoms at last night's AMI Awards in Melbourne.

Clems Sydney CEO Andy Pontin Quits
  • Advertising

Clems Sydney CEO Andy Pontin Quits

Sure, B&T flashed the news of Andy Pontin quitting this morning. White lies aside, he's actually still got six months.

by B&T Magazine

B&T Magazine
Adobe MAXes Most Creatives In A Room Record
  • Advertising
  • Media

Adobe MAXes Most Creatives In A Room Record

B&T's journo is reporting live from the annual Adobe Summit in Vegas. Although, "reporting" is somewhat of a stretch.

Opinion

by David Hovenden

David Hovenden
Digital Women’s Network & The Australian College Of Marketing Unveil Latest Short Courses
  • Marketing

Digital Women’s Network & The Australian College Of Marketing Unveil Latest Short Courses

The Australian College of Marketing is collaborating with the Digital Women’s Network to bring new short courses aimed to provide the latest skills across all aspects of the Digital landscape, kicking off in Melbourne and Sydney in 2018. Course content will focus around various topics related to the digital marketing landscape. All courses will run […]

Man working at office desk, looking at computer and scratching head
  • Technology

Where Are Digital & Tech Skills & Salaries Headed?

The rapid pace of technological change in the digital sector is seeing demand for those with the right skill sets outstrip availability, both locally and globally. The individuals who have kept their skills up to date are being well-rewarded financially. Now, Digital + Technology Collective’s expanded annual Skills and Salary Survey will put some numbers and context […]

Disney & ESPN Unify Sales & Partnerships Teams
  • Advertising
  • Marketing
  • Media

Disney & ESPN Unify Sales & Partnerships Teams

Disney and ESPN have formed an even closer bond, announcing a new alignment of the two properties through their media sales and partnerships teams. Instead of entering through three doors, Disney ESPN Media Sales & Partnerships will give media buyers and marketers a refined, singular point of entry for Disney, ESPN Digital and Maker. Nik […]

by B&T Magazine

B&T Magazine
Sydney Start-up Muzaara Partners With Commission Factory To Turbocharge Digital Ad Spends
  • Advertising
  • Marketing

Sydney Start-up Muzaara Partners With Commission Factory To Turbocharge Digital Ad Spends

Sydney-based adtech start-up Muzaara has announced a new strategic partnership with performance marketing platform Commission Factory. Together, Muzaara and Commision Factory are providing SMEs with a secret weapon to skyrocket their online brand visibility and effectively manage and maximise their online advertising campaigns. This partnership will allow both online marketing companies and their impressive roster […]

Kellogg’s Creates AR Halloween Trick Or Treat Experience Via Shazam & Orchard
  • Campaigns
  • Marketing
  • Technology

Kellogg’s Creates AR Halloween Trick Or Treat Experience Via Shazam & Orchard

Breakfast cereal manufacturer Kellogg’s has joined forces with Shazam and digital agency Orchard to deliver a first-of-its-kind augmented reality (AR) Halloween Trick or Treat experience for families. The campaign, which leverages Shazam’s visual recognition platform and recently-launched AR platform, sees Kellogg’s pilot the replacement of physical gifts in cereal packs with a digital experience that […]