Google Warns Artificial Intelligence Is Not Without Its Dangers

Google Warns Artificial Intelligence Is Not Without Its Dangers
SHARE
THIS



Worried that the Google Brain might eventually get a mind of its own? Don’t worry, so is the Google Brain – or at least its human analogue.

In a company blog, Chris Olah, Google Research revealed that the software giant “… is thinking through potential challenges and how best to address any associated risks” with artificial intelligence along with scientists from OpenAI, Stanford and Berkeley.

Together, the parties have produced an initial technical paper called Concrete Problems in AI Safety

Olah’s blog described the following five problems as forward thinking, long-term research questions. He said they are “minor issues today, but important to address for future systems”.

  • Avoiding Negative Side Effects: How can we ensure that an AI system will not disturb its environment in negative ways while pursuing its goals? For example, a cleaning robot knocking over a vase because it can clean faster by doing so.
  • Avoiding Reward Hacking: How can we avoid gaming of the reward function? For example, we don’t want this cleaning robot simply covering over messes with materials it can’t see through.
  • Scalable Oversight: How can we efficiently ensure that a given AI system respects aspects of the objective that are too expensive to be frequently evaluated during training? For example, if an AI system gets human feedback as it performs a task, it needs to use that feedback efficiently because asking too often would be annoying.
  • Safe Exploration: How do we ensure that an AI system doesn’t make exploratory moves with very negative repercussions? For example, maybe a cleaning robot should experiment with mopping strategies, but clearly it shouldn’t try putting a wet mop in an electrical outlet.
  • Robustness to Distributional Shift: How do we ensure that an AI system recognises, and behaves robustly, when it’s in an environment very different from its training environment? For example, heuristics learned for a factory workfloor may not be safe enough for an office.

“While possible AI safety risks have received a lot of public attention, most previous discussion has been very hypothetical and speculative,” wrote Olah. “We believe it’s essential to ground concerns in real machine learning research, and to start developing practical approaches for engineering AI systems that operate safely and reliably.”

This article originally appeared on B&T’s sister business site www.which-50.com

Please login with linkedin to comment

Latest News

Lord Of The Fries Pays Homage To Kanye West & Kendrick Lamar In Clever Ads Via Milkman
  • Advertising
  • Campaigns

Lord Of The Fries Pays Homage To Kanye West & Kendrick Lamar In Clever Ads Via Milkman

Creative digital agency Milkman has helped Lord of the Fries (LOTF) pay homage to two of the fast food outlet’s favourite artists through a series of clever art poster adverts. Milkman re-created the latest album covers of Kanye West and Kendrick Lamar with a LOTR vibe to highlight the brand’s hip-hop roots and its favourite albums […]

A Rapping Horse Stars In Wonderfully Nuts Bingo Ad
  • Campaigns

A Rapping Horse Stars In Wonderfully Nuts Bingo Ad

It’s Friday and has your brain largely racked the cue for the week? Well, B&T reckons Friday’s no better time for some utter nonsense and we’re delivering in spades today with this whacky spot from UK’s The Sun newspaper (fear no, there’s no topless Page threes). The two-minute spot’s via London agency The & Partnership and is flogging […]

by B&T Magazine

B&T Magazine
Keep Left Wins PR Account For Greening Australia
  • Marketing

Keep Left Wins PR Account For Greening Australia

PR and content marketing agency Keep Left has been selected by proactive conservation organisation Greening Australia to raise public awareness of its flagship programs and national footprint. The relationship began in 2017 when Greening Australia engaged Keep Left in support of Reef Aid, a project launched with corporate partner Virgin Australia to improve water quality […]

VMO & Unilever Partner To Launch Streets ‘Talking Ice Cream’ Summer Campaign
  • Advertising
  • Marketing

VMO & Unilever Partner To Launch Streets ‘Talking Ice Cream’ Summer Campaign

In a market first for VMO and Streets, Unilever partnered with the Outdoor advertising network to launch their ‘Talking Ice Cream’ summer campaign via a fully-automated, real time dashboard solution. Designed by VMO, the custom-built platform enabled Streets to serve dynamic, geo-targeted messaging triggered by current news, weather and events in real-time. Multiple creative assets […]

Dentsu Aegis Network’s The Search Factory Rebrands
  • Marketing

Dentsu Aegis Network’s The Search Factory Rebrands

Performance and data agency iProspect has announced that The Search Factory, which was acquired by Dentsu Aegis Network in June 2016, will rebrand to iProspect in Brisbane. This announcement marks the official launch of the iProspect brand in Brisbane, with the team of 29 adding to their Melbourne, Sydney and Auckland offices, and joining a […]

The 10 Trends For Brand-Consumer Relationships This Year
  • Marketing

The 10 Trends For Brand-Consumer Relationships This Year

Aussies want brands to stand for something that matters and to know there are more social groups than just Millennials, according to a new report. Independent Aussie media agency The Media Store’s 2018 Trend Forecast details the top 10 trends for brand-consumer relationships this year. Helen Karabassis (pictured above), head of research and insights at […]

Australia’s News Media Audience Grows For Second Consecutive Year: emma
  • Media

Australia’s News Media Audience Grows For Second Consecutive Year: emma

News media grew by 2 per cent in 2017 for the second consecutive year, according to the latest emma (Enhanced Media Metrics Australia) data1. In December 2017, 16.9 million people, or 90 per cent of the population (aged 14 and over), read news media across all platforms. Almost three quarters of the population (74 per cent, […]

Study: TV Ads Outperform Facebook & YouTube For Sales Impact, Regardless Of Screen Type
  • Advertising
  • Media

Study: TV Ads Outperform Facebook & YouTube For Sales Impact, Regardless Of Screen Type

New research from respected marketing science academic professor Karen Nelson-Field has uncovered new insights into how and why video advertising works for brands when viewed on mobile devices. The mobile edition of Nelson-Field’s ongoing Benchmark Series, commissioned by ThinkTV, makes a number of significant findings that are designed to help advertisers and their agencies get […]

Now Screen Repositions Organic Care Brand With New Campaign
  • Advertising
  • Campaigns

Now Screen Repositions Organic Care Brand With New Campaign

Aussie agency Now Screen has teamed up with Organic Care to reposition the brand in what has become one of the most competitive FMCG spaces. The new campaign, ‘Caring Comes Naturally’, celebrates what Organic Care has created since its inception: products that are as good for your body as they are for the environment. In […]

Can You Speak Data?
  • Marketing
  • Opinion

Can You Speak Data?

We're certainly fluent in gibberish, balderdash and claptrap here at B&T, but sadly data isn't part of the lexicon.

Opinion

by B&T Magazine

B&T Magazine
Social Change Maker Profile: Emma Heath
  • Advertising
  • Marketing
  • Media

Social Change Maker Profile: Emma Heath

B&T has partnered with UnLtd to showcase industry heroes! Well, it's arguably more heroine in the case of Emma Heath.

by B&T Magazine

B&T Magazine
Ad Fraud: A Problem We Can Solve
  • Advertising
  • Opinion
  • Technology

Ad Fraud: A Problem We Can Solve

Unlike B&T's mystery office farter, this columnist argues ad fraud is a problem that can possibly be solved.

Opinion

by B&T Magazine

B&T Magazine
Why We Pivoted Our ‘Specialist’ Agency Five Times In 15 Years
  • Marketing
  • Opinion

Why We Pivoted Our ‘Specialist’ Agency Five Times In 15 Years

In this opinion piece, Gavin McDonough (pictured above, co-founder and managing partner of Urban, shares through his own experience some valuable advice for independent specialist agencies. In November 2017, my brother Ryan and I celebrated 15 years in business. We started business out of my front room in Melbourne in 2002 – not with any grand […]

Opinion

by B&T Magazine

B&T Magazine
W+K’s Susan Hoffman Chosen As 39th AWARD Awards Chair Of Judges
  • Advertising

W+K’s Susan Hoffman Chosen As 39th AWARD Awards Chair Of Judges

Susan Hoffman, co-chief creative officer at Wieden+Kennedy (W+K), has been appointed chair of judges for the 39th AWARD Awards. Known to challenge the status quo, Hoffman is behind some of W+K’s most memorable and game-changing ads, including Nike’s ‘Revolution’, Old Spice’s ‘The Man Your Man Could Smell Like’ and Chrysler’s Super Bowl spots starring Eminem and Clint […]

Experiential Agency Kreate Gets Bought Out By Staffers
  • Marketing

Experiential Agency Kreate Gets Bought Out By Staffers

Leading experiential marketing agency, Kreate Australia is embarking on an exciting growth strategy following its purchase by three of the agency’s existing management team from its UK founder, Steve Evans.

Hurry! B&T 30 Under 30 Entries Closing Friday!
  • Advertising
  • Marketing
  • Media

Hurry! B&T 30 Under 30 Entries Closing Friday!

This is a clarion call for B&T 30 Under 30 entries, although it's probably more mariachi band than angelic harbinger.

by B&T Magazine

B&T Magazine
The Hit Network Chooses Comedian Tanya Hennessy To Host Weekend Breakfast
  • Media

The Hit Network Chooses Comedian Tanya Hennessy To Host Weekend Breakfast

Southern Cross Austereo’s Hit Network has announced that rising radio star and comedian Tanya Hennessy will take over hosting duties for its weekend breakfast slot in 2018. Hennessy will bring content to the airwaves each Saturday and Sunday morning from 7am to 9am with a regular rotation of guest co-hosts. The self-described talker, not walker […]

Straight Up PR Wins Five New Clients
  • Marketing

Straight Up PR Wins Five New Clients

Health, wellbeing and lifestyle PR agency Straight Up PR has welcomed Changing Habits, Unichi Wellness, enerGi, SleepX, and Healthie Hampers to its client portfolio. Straight Up PR’s projects will include bespoke PR services and influencer marketing packages specifically focusing on communications strategy and execution, media and influencer relations, PR launch events, product seeding and gifting, […]

March One Creates ‘Cheese For Change’ Fundraising Campaign For White Ribbon Australia
  • Advertising
  • Campaigns
  • Marketing

March One Creates ‘Cheese For Change’ Fundraising Campaign For White Ribbon Australia

Independent creative agency March One has developed a new fundraising event for White Ribbon Australia that turns a social moment into a social movement. Starting on Thursday 22 March and going until Sunday 25 March, Cheese for Change will ask Aussies to create a cheese platter that matters by gathering friends, family or co-workers together […]

Sixth Annual IGN Select Awards Winners Announced
  • Marketing

Sixth Annual IGN Select Awards Winners Announced

The winners of IGN Australia’s sixth annual Select Awards were revealed during a huge special event at the Australian National Maritime Museum in Sydney on Friday, February 16. Some 225 Media & Game Publishers alongside 320 IGN Community Gamers attended the annual event. 2017 was absolutely crammed with terrific games and several categories were extremely tightly-contested. The top […]

Meet Your Mentors For B&T Bootcamp 2018!
  • Advertising
  • Marketing
  • Media

Meet Your Mentors For B&T Bootcamp 2018!

When it comes to an industry "who's who", you'll find there won't be too much who-ing with this impressionable lot.

by B&T Magazine

B&T Magazine
ANZ Unveils Its 2018 GAYTMs
  • Marketing

ANZ Unveils Its 2018 GAYTMs

Mardi Gras is only weeks away and B&T has already hoisted the mirror ball and donned the hotpants to bring you this.