The Unconscious Bias In Facebook’s Moderation Problem

The Unconscious Bias In Facebook’s Moderation Problem
SHARE
THIS



Following the recent leak of Facebook’s moderation practices, online community expert, Venessa Paech (pictured below), covers the myriad challenges for the platform, and where to next for Facebook and its users in this guest post for B&T…

Facebook’s moderation practices are in the news yet again, as more detail of their playbook was leaked to the public (aka, their users) recently. They highlight alarming inconsistencies and a disdain for duty of care. But they also illuminate the bias at the heart of the problem.

Venessa Paech%5b1%5d%5b1%5d

Technology isn’t neutral. Like any other tool, it’s imbued with the assumptions, expectations, politics and predilections of those who create it. It’s shaped by the experience and perspectives those doing the tooling have lived up to that moment. We’re getting better at recognising and responsibly managing unconscious bias in our businesses and organisations. But we’re pretty ordinary at calling it out when it comes to social networks that feature prominently in our daily lives.

The standard push-back to more responsible content and user regulation on Facebook is concern over censorship (driven primarily by a nativist US perspective). This is, of course, a straw man argument. Facebook policies and positions already ‘censor’. Terms of service prohibit certain behaviours and activities. This is the beginning of curating a culture – at the margins.

When Facebook moderators remove a personal picture of a mother breastfeeding, but not a graphic rape or death threat, they’re making choices and creating cultural norms. These interventions are based on an explicit world view and legal lens particular to a small portion of actual users. They don’t consider community context and they ignore the fact they’re already a form of ‘censorship’.

When someone is intimidated or threatened out of participation, censorship is in effect. Women and other institutionalised marginalised groups are routinely drummed out of the virtual room by armies of trolls, men’s rights activists or the loudest hater in the room at any given moment. For some it’s a matter of life and death, where speaking up or speaking out provokes the ultimate attempt to silence – doxing (posting personally identifiable details like address or phone number, with the invitation to harass or stalk that person).

Facebook reporting tools, though better than they once were, still suffer from an either/or, square peg/round-hole problem, with inadequate categories to accommodate the thrilling range of abuse directed at women on the platform. And of course there are the all-too-common cases of people in crisis, (again, usually women), seeking the connectivity and support of their personal social network, but needing to cloak their identity and online activity from abusive parties.

Facebook will tell you repeatedly that they are committed to improving their content reporting capabilities, making it ‘easier’ and ‘faster’ to raise alarm. But reports are still in relation to Facebook’s ‘standards’, and it’s there that unconscious bias needs tackling first. By prioritising profit over harm minimisation, by intentionally refusing to use available technology to quarantine graphic content, and by ignoring their wider unconscious bias, Facebook is complicit.

Twitter founder Evan Williams recently issued a sincere mea culpa for what he now understands as Twitter’s role in mobilising toxic behaviour. I like and admire Evan, but was surprised at the naiveté of his comment: “I thought once everyone could speak freely and exchange information and ideas, the world was automatically going to be a better place. I was wrong about that.” I’m pretty sure most women (and other institutionally marginalised voices) would have had a safe bet what was in store; and some suggestions about better tools to help manage it.

Facebook has taken positive steps to scrutinise and address employer-side unconscious bias. But this doesn’t yet filter through to the platform itself. A diversity of perspectives in the room allows Facebook to more accurately map risk scenarios and desired user journeys. How many women or people of colour were involved when their now infamous moderation playbook was created? How many did they run it by to see if it tracked with lived experience? Were there anthropologists and ethnographers working alongside the lawyers? Diversity makes better products. It also makes safer, more equitable ones. Lessons from community management and the world of social science teach us that when people feel they can disclose without threat, they’re more likely to (ironically, revealing the kind of intimate data Facebook transforms into product, currency and share price).

Social and community professionals manage millions of groups across their platform, not to mention the ‘accidental’ community managers who voluntarily administrate local groups and communities of interest. One way to help scale the mountain of moderation is to engage these people in the creation of tools to manage and create a group culture that reflects their values and their needs. There are signs Facebook is starting to address this, with a ‘Communities Summit’ in Chicago connecting group admins with Facebook staff (including Zuckerberg himself). However, there is a rigorous application process and, for now at least, it’s only open to U.S admins. We watch with interest to see if the conversation is about ‘getting more out of Facebook’, or listening to community management needs with an intent to act.

Imagine where we might be if this decade-old business had engaged community experts and others outside its filter bubble to begin with? Imagine what a commitment to transparency could accomplish on all sides?

Venessa Paech is the Co-Founder of Swarm, Australia’s premier community management conference. Tickets now on sale at www.swarmconference.com.au

 

Latest News

Women In Media Profile: Aimee Buchanan
  • Media

Women In Media Profile: Aimee Buchanan

No Women in Media series would be complete without the irrepressible Aimee Buchanan. Read all her pressibles here.

by B&T Magazine

B&T Magazine
Nike Disses Mollycoddled Chinese Kids In New Upbeat Spot
  • Campaigns

Nike Disses Mollycoddled Chinese Kids In New Upbeat Spot

Years of China’s ‘one child policy’ has apparently left a generation of mollycoddled kids too scared to get sweaty or dirty. But now a new campaign by Nike China has set out to debunk the idea that Chinese kids are spoiled little fatties wrapped in cotton-wool. The campaign’s the work of R/GA Shanghai and is an upbeat, positive number with a booming […]

by B&T Magazine

B&T Magazine
MS Queensland Unveils ‘MS Stops You In Your Tracks’ Campaign
  • Campaigns

MS Queensland Unveils ‘MS Stops You In Your Tracks’ Campaign

An MS diagnosis – at an average age of just 30 – means a lifelong battle with a disease that attacks the central nervous system in any number of ways. While most people have heard of multiple sclerosis, few understand what it is or how it impacts people’s lives. In partnership with MS Queensland, creative […]

Revealed: The Real Voice Behind Siri
  • Technology

Revealed: The Real Voice Behind Siri

For the third consecutive year, TEDxSydney selected creative agency BMF to produce a film for its 2018 film program under the theme ‘Humankind’. The film, which premiered on Friday in front of 5000 people at TEDx Sydney, unmasks the real genius behind Apple’s personal assistant Siri. “Siri is an amazing invention. You can ask her […]

MercerBell Calls In Two New Data Hires
  • Marketing
  • Technology

MercerBell Calls In Two New Data Hires

Proving many photos shot on an iPhone so often come out washed-out and grainy comes this article's accompanying pic.

Intrepid Travel Go Back 30 Years, Posting Classified Adverts In Newspapers
  • Campaigns

Intrepid Travel Go Back 30 Years, Posting Classified Adverts In Newspapers

Intrepid Travel has gone back in time and is placing classified adverts for a new ‘mystery expedition’ to places that yet mapped by Google.  The adverts to be placed in Courier Mail, Herald Sun and Sunday Telegraph are calling for intrepid people to join a journey with “long travel days, intermittent electricity, no Wi-Fi, cold […]

Watching tv and using remote control
  • Advertising
  • Media

GroupM Investment Forecast For Australia: TV On The Rise As Digital Slips

GroupM has updated its 2018 ad investment forecasts and released its initial 2019 outlook. GroupM predicts $24B in net new advertising investment this year, the best annual increment since the bounce back from the global recession in 2010 when $26B was added to investment. GroupM estimates total advertising investment will grow by 4.5 per cent this year […]

Indigenous Campaign Deemed Too Controversial By APN Media To Run
  • Advertising
  • Campaigns

Indigenous Campaign Deemed Too Controversial By APN Media To Run

Aboriginal Victoria’s campaign in support of Australia’s first-ever treaty legislation, Deadly Questions, has been deemed too controversial to run by one of Australia’s leading outdoor media providers, APN Media. Online platform Deadly Questions provides a safe space for people to ask questions and have them answered by Aboriginal Victorians, to learn more about their cultures, […]

Introducing: YouTube Music Australia
  • Technology

Introducing: YouTube Music Australia

The wait is over! Starting today, YouTube Music is available to everyone in Australia, New Zealand, the U.S, Mexico and South Korea in addition to 12 new countries including Austria, Canada, Finland, France, Germany, Ireland, Italy, Norway, Russia, Spain, Sweden, and the United Kingdom. Now fans around the world can find more of the music […]

Will PR Finally Earn Its Stripes At Cannes This Year?
  • Opinion

Will PR Finally Earn Its Stripes At Cannes This Year?

In this guest post, Haystac’s national general manager, Jason Carnew (pictured below), says with all this talk of Cannes at this time of year, it’s a kindly reminder that the PR business needs to get its act together in terms of awards, work and judging… All eyes on are Cannes as some of the best […]

Opinion

by B&T Magazine

B&T Magazine
Ex-DDBer Unveils Designer Headscarves For Cancer Survivors
  • Campaigns

Ex-DDBer Unveils Designer Headscarves For Cancer Survivors

Two-times cancer survivor, Frankie Good Stuff Award Winner, ex-DDBer and founder of Bravery Co. Emily Somers has collaborated with a range of top-notch illustrators to produce Australia’s first range of designer headscarves for young cancer warriors. She is now crowdfunding $40,000 to produce the scarves and donate one to all the young women in their 20’s […]

New Advertising Platform Launches Down Under
  • Advertising

New Advertising Platform Launches Down Under

Following its massive success in Europe, Asia and the UAE, the Polishoe concept, which brings a high-demand shoe polish service and HD digital advertising platform together, has landed in Australia.

Set for blue sky, different clouds icons, cloud shapes, labels, symbols, icons. Flat graphic vector elements
  • Technology

PubMatic Unveils Cloud for Publishers And Tech Companies

PubMatic has launched PubMatic Cloud for publishers and tech companies looking to implement and control their own programmatic technology. By accessing PubMatic’s technology, global infrastructure and demand connections on a platform-as-a-service (PaaS) basis, clients are able to achieve full transparency and achieve greater control over their programmatic monetization. As programmatic trading becomes mainstream, innovations such as […]

Women In Media Profile: Claudine Hall
  • Media

Women In Media Profile: Claudine Hall

The Women in Media Awards are back for 2018! To celebrate this wonderful fact, and to recognise some of the killer women in our industry, we’ve created a women in media series – and have profiled some pretty inspiring women so far. This week, we chat with Bauer Media head of trade marketing Claudine Hall. […]

by B&T Magazine

B&T Magazine
Cancer Council and Target Tradies Tackle On-The-Job Skin Cancer Risks
  • Campaigns

Cancer Council and Target Tradies Tackle On-The-Job Skin Cancer Risks

Workers on construction sites receive five to 10 times more UV exposure every year compared to indoor workers. Target Tradies and Cancer Council have announced the launch of a partnership to help educate Australian construction workers about the importance of being SunSmart at work. With evidence showing that outdoor workers receive five to 10 times […]

Arq Group Activates New Branding By Hulsbosch  
  • Media

Arq Group Activates New Branding By Hulsbosch  

Arq Group has launched a new identity created by award-winning agency Hulsbosch, with the business rebranding from Melbourne IT to Arq. Previously known as Melbourne IT, the company was founded in 1996 as one of Melbourne University’s commercial ventures with the sole rights to manage .au domains in the early days of the Internet. Melbourne IT […]

Adshel Unveils ANZ Takeover Via PHD
  • Campaigns
  • Media

Adshel Unveils ANZ Takeover Via PHD

ANZ, in partnership with PHD and Adshel, have taken to the streets with a total take-over of the entire Adshel Live network. For one hour, between 8am and 9am on Tuesday 19 June, ANZ is inviting commuters to download the new ANZ app by showing six different ways the app can help them manage their […]

Carat & Initiative Share The Spoils In WA Government’s $65 Million Media Business
  • Media

Carat & Initiative Share The Spoils In WA Government’s $65 Million Media Business

IPG’s Initiative and Dentsu’s Carat have both been awarded a slice of the West Australian government’s $65 million spend. The government account is broken into two entities – campaign and non-campaign – each with its own agency roster. Carat has retained its long-standing position on the agency panel for all campaign work, which accounts for […]

A Golden Opportunity! Lucky Numbers For Sale!
  • Marketing

A Golden Opportunity! Lucky Numbers For Sale!

In case you missed it last week, a very lucky phone number – 1800 80 80 80 – is up for sale. And it could be yours!

Partner Content

by Customer Connect

The AppNexus Marketplace Launches Guaranteed Views
  • Technology

The AppNexus Marketplace Launches Guaranteed Views

AppNexus, the world’s leading independent advertising technology company, today announced the launch of Guaranteed Views, a marketplace product that changes the way advertising is bought and sold on the open internet. Guaranteed Views enables marketers and agencies to pay only for ads that are measured as viewable and is the first programmatic product that enables 100% viewable buying at scale outside of Facebook and Google.

Women In Media Profile: Kirsty Bloore
  • Media

Women In Media Profile: Kirsty Bloore

Bereft of any Monday motivation? Let today's Women in Media profile be like low-current electric waves to the brain.

by B&T Magazine

B&T Magazine