The Unconscious Bias In Facebook’s Moderation Problem

The Unconscious Bias In Facebook’s Moderation Problem
SHARE
THIS



Following the recent leak of Facebook’s moderation practices, online community expert, Venessa Paech (pictured below), covers the myriad challenges for the platform, and where to next for Facebook and its users in this guest post for B&T…

Facebook’s moderation practices are in the news yet again, as more detail of their playbook was leaked to the public (aka, their users) recently. They highlight alarming inconsistencies and a disdain for duty of care. But they also illuminate the bias at the heart of the problem.

Venessa Paech%5b1%5d%5b1%5d

Technology isn’t neutral. Like any other tool, it’s imbued with the assumptions, expectations, politics and predilections of those who create it. It’s shaped by the experience and perspectives those doing the tooling have lived up to that moment. We’re getting better at recognising and responsibly managing unconscious bias in our businesses and organisations. But we’re pretty ordinary at calling it out when it comes to social networks that feature prominently in our daily lives.

The standard push-back to more responsible content and user regulation on Facebook is concern over censorship (driven primarily by a nativist US perspective). This is, of course, a straw man argument. Facebook policies and positions already ‘censor’. Terms of service prohibit certain behaviours and activities. This is the beginning of curating a culture – at the margins.

When Facebook moderators remove a personal picture of a mother breastfeeding, but not a graphic rape or death threat, they’re making choices and creating cultural norms. These interventions are based on an explicit world view and legal lens particular to a small portion of actual users. They don’t consider community context and they ignore the fact they’re already a form of ‘censorship’.

When someone is intimidated or threatened out of participation, censorship is in effect. Women and other institutionalised marginalised groups are routinely drummed out of the virtual room by armies of trolls, men’s rights activists or the loudest hater in the room at any given moment. For some it’s a matter of life and death, where speaking up or speaking out provokes the ultimate attempt to silence – doxing (posting personally identifiable details like address or phone number, with the invitation to harass or stalk that person).

Facebook reporting tools, though better than they once were, still suffer from an either/or, square peg/round-hole problem, with inadequate categories to accommodate the thrilling range of abuse directed at women on the platform. And of course there are the all-too-common cases of people in crisis, (again, usually women), seeking the connectivity and support of their personal social network, but needing to cloak their identity and online activity from abusive parties.

Facebook will tell you repeatedly that they are committed to improving their content reporting capabilities, making it ‘easier’ and ‘faster’ to raise alarm. But reports are still in relation to Facebook’s ‘standards’, and it’s there that unconscious bias needs tackling first. By prioritising profit over harm minimisation, by intentionally refusing to use available technology to quarantine graphic content, and by ignoring their wider unconscious bias, Facebook is complicit.

Twitter founder Evan Williams recently issued a sincere mea culpa for what he now understands as Twitter’s role in mobilising toxic behaviour. I like and admire Evan, but was surprised at the naiveté of his comment: “I thought once everyone could speak freely and exchange information and ideas, the world was automatically going to be a better place. I was wrong about that.” I’m pretty sure most women (and other institutionally marginalised voices) would have had a safe bet what was in store; and some suggestions about better tools to help manage it.

Facebook has taken positive steps to scrutinise and address employer-side unconscious bias. But this doesn’t yet filter through to the platform itself. A diversity of perspectives in the room allows Facebook to more accurately map risk scenarios and desired user journeys. How many women or people of colour were involved when their now infamous moderation playbook was created? How many did they run it by to see if it tracked with lived experience? Were there anthropologists and ethnographers working alongside the lawyers? Diversity makes better products. It also makes safer, more equitable ones. Lessons from community management and the world of social science teach us that when people feel they can disclose without threat, they’re more likely to (ironically, revealing the kind of intimate data Facebook transforms into product, currency and share price).

Social and community professionals manage millions of groups across their platform, not to mention the ‘accidental’ community managers who voluntarily administrate local groups and communities of interest. One way to help scale the mountain of moderation is to engage these people in the creation of tools to manage and create a group culture that reflects their values and their needs. There are signs Facebook is starting to address this, with a ‘Communities Summit’ in Chicago connecting group admins with Facebook staff (including Zuckerberg himself). However, there is a rigorous application process and, for now at least, it’s only open to U.S admins. We watch with interest to see if the conversation is about ‘getting more out of Facebook’, or listening to community management needs with an intent to act.

Imagine where we might be if this decade-old business had engaged community experts and others outside its filter bubble to begin with? Imagine what a commitment to transparency could accomplish on all sides?

Venessa Paech is the Co-Founder of Swarm, Australia’s premier community management conference. Tickets now on sale at www.swarmconference.com.au

 

Latest News

GDPR “Could Be A Content Killer”, Says Expert
  • Advertising
  • Media

GDPR “Could Be A Content Killer”, Says Expert

The way the European Union’s General Protection Data Regulation (GDPR) is interpreted could have a severe impact on publishers, according to one expert. The GDPR was introduced on 25 May 2018 to help consumers protect their data and reshape the way organisations approach data privacy through a consent model. Speaking recently at a roundtable event […]

by B&T Magazine

B&T Magazine
Ipsos Appoints Ex-Nielsen Exec As CEO Of South East Asia
  • Media

Ipsos Appoints Ex-Nielsen Exec As CEO Of South East Asia

Ipsos chairman and CEO Didier Truchot has appointed former Nielsen executive Suresh Ramalingam as CEO of South East Asia. Ramalingam’s remit includes Singapore, Malaysia, Thailand, Indonesia, Vietnam and the Philippines, with immediate effect. Ramalingam joins Ipsos from Nielsen, where he worked for more than two decades in various leadership roles covering the Middle East and Africa, South East […]

adblock popup web banner concept. isolated vector
  • Opinion

How To Reach The Unreachables

The unreachables may sound like the Indian caste system but, as you'll learn here, it's some newfangled marketing term.

Opinion

by B&T Magazine

B&T Magazine
Instagram Video: We Are Living In A Vertical World
  • Co-Lab

Instagram Video: We Are Living In A Vertical World

The way people record, share and replay their lives has changed dramatically since the advent of Facebook-owned Instagram. Once a place where only static, filtered photos could be uploaded, Instagram now offers photo and video uploads, shopping features, direct messaging and several other tools serving users and businesses. However, for Instagram head of business Jim Squires […]

by B&T Magazine

B&T Magazine
Yes! It’s Virtual Reality Demystified
  • Co-Lab

Yes! It’s Virtual Reality Demystified

Virtual Reality has been a staple of science fiction for some time, Though, in terms of real-life application, the world is still coming to grips with what the tool can offer us. In recent years, tech experts, doctors, medical students and videographers have used the tool as a way of exploring worlds not normally accessed in […]

by B&T Magazine

B&T Magazine
Facebook Messenger: The New Age Of Communications
  • Co-Lab

Facebook Messenger: The New Age Of Communications

The unparalleled success of Facebook-owned Messenger can be pinned down to its ear to the ground approach with users. Consistently listening to its user base of more than one billion, Messenger’s ability to stay not only on trend but well ahead of it has allowed the app to become a global tool for communication; be that […]

Industry Generates A Record $10.5m For Social Impact
  • Media

Industry Generates A Record $10.5m For Social Impact

UnLtd, the media, marketing and creative industry’s social purpose organisation has announced a total industry contribution of $10.5m to social impact in FY18. The total value of funds, services, inventory and time donated by the media, marketing and creative industry increased by 21per cent compared to the previous financial year due to a growth in […]

Women In Media Profile: Danni Wright
  • Media

Women In Media Profile: Danni Wright

We'd be headlining Danni Wright's Women in Media profile the "Wright stuff" if it wasn't utterly predictable and naff.

by B&T Magazine

B&T Magazine
Posterscope Promotes Two
  • Media

Posterscope Promotes Two

Posterscope, Dentsu Aegis Network’s specialist out-of-home agency, has promoted Ryan Hedditch to the newly created position of national head of strategy and Samantha Summers to Sydney Group Business Director. In his new role, Hedditch is charged with driving the continual improvement and transformation of the Posterscope offering to clients and partners. Summers’ promotion will see her lead […]

Outbrain Accelerates Growth With APAC Promotions
  • Media

Outbrain Accelerates Growth With APAC Promotions

Native discovery platformOutbrain has announced several movements in its regional leadership team, with plans to make more new hires. This comes on the heels of two senior appointments it made in February, after closing a record year in the region with expansion into new markets. Yoav Tourel has been promoted to head of sales for […]

Clems Syd & Extra GUM Unveil YouTube Digital Stage
  • Media

Clems Syd & Extra GUM Unveil YouTube Digital Stage

YouTube EXTRA Gum has launched EXTRA Support Acts, a program created to support Australia’s up and coming musicians by transforming pre-roll ads on YouTube into a digital support stage. It has been created in partnership with Clemenger BBDO Sydney as creative lead, Universal Music Australia and BRING for talent and music strategy and content, MediaCom and YouTube. The […]

OMD Australia Tops 2018 RECMA Rankings
  • Media

OMD Australia Tops 2018 RECMA Rankings

OMD Australia has taken the top spot for Australia’s Number 1 media agency in size, according to RECMA’s 2018 ‘Overall Activity Volume Rankings’ report released last week. Additionally, the company was named first in profile classification with a dominant profile for the 3rd consecutive year, along with vitality ranking and structure ranking. Furthermore, OMD Australia was also named […]

Red Agency Bolsters Sydney Team
  • Media

Red Agency Bolsters Sydney Team

Judging by the image, it seems Red Agency may have had no staff whatsoever prior to this hiring spree.

Nine Appoints Editor For 9Honey
  • Media

Nine Appoints Editor For 9Honey

B&T's editor coincidentally spilled honey on his shirt while typing this. And by typing, we mean copy and pasting.

Y&R Sydney Scores Best&Less   
  • Advertising
  • Media

Y&R Sydney Scores Best&Less  

Y&R wins Best&Less amid rumours the clothing shop its changing name to 'Somewhat OK&Reasonably cheap'.