Google Warns Artificial Intelligence Is Not Without Its Dangers

Google Warns Artificial Intelligence Is Not Without Its Dangers
SHARE
THIS



Worried that the Google Brain might eventually get a mind of its own? Don’t worry, so is the Google Brain – or at least its human analogue.

In a company blog, Chris Olah, Google Research revealed that the software giant “… is thinking through potential challenges and how best to address any associated risks” with artificial intelligence along with scientists from OpenAI, Stanford and Berkeley.

Together, the parties have produced an initial technical paper called Concrete Problems in AI Safety

Olah’s blog described the following five problems as forward thinking, long-term research questions. He said they are “minor issues today, but important to address for future systems”.

  • Avoiding Negative Side Effects: How can we ensure that an AI system will not disturb its environment in negative ways while pursuing its goals? For example, a cleaning robot knocking over a vase because it can clean faster by doing so.
  • Avoiding Reward Hacking: How can we avoid gaming of the reward function? For example, we don’t want this cleaning robot simply covering over messes with materials it can’t see through.
  • Scalable Oversight: How can we efficiently ensure that a given AI system respects aspects of the objective that are too expensive to be frequently evaluated during training? For example, if an AI system gets human feedback as it performs a task, it needs to use that feedback efficiently because asking too often would be annoying.
  • Safe Exploration: How do we ensure that an AI system doesn’t make exploratory moves with very negative repercussions? For example, maybe a cleaning robot should experiment with mopping strategies, but clearly it shouldn’t try putting a wet mop in an electrical outlet.
  • Robustness to Distributional Shift: How do we ensure that an AI system recognises, and behaves robustly, when it’s in an environment very different from its training environment? For example, heuristics learned for a factory workfloor may not be safe enough for an office.

“While possible AI safety risks have received a lot of public attention, most previous discussion has been very hypothetical and speculative,” wrote Olah. “We believe it’s essential to ground concerns in real machine learning research, and to start developing practical approaches for engineering AI systems that operate safely and reliably.”

This article originally appeared on B&T’s sister business site www.which-50.com

Please login with linkedin to comment

cigarettes einsights PRIA

Latest News

NITV Announces Four Indigenous Executive Appointments
  • Media

NITV Announces Four Indigenous Executive Appointments

National Indigenous television service NITV has announced four senior Indigenous appointments who will be responsible for growing its on-air and online platforms. Rhanna Collins, a proud Palawa woman, has worked at NITV for the past four years and has been appointed as executive editor, working across the TV station’s news and current affairs digital and […]

Publicis & Qld Transport And Main Roads Department Launch #LiftLegends
  • Campaigns

Publicis & Qld Transport And Main Roads Department Launch #LiftLegends

Queensland’s Transport and Main Roads Department (TMR) and creative agency Publicis Worldwide are targeting drink-driving over the holiday season with a new road safety campaign launching this week. The campaign is encouraging people to organise a #LiftLegend to make their way home. Set to the Bette Midler classic, Wind Beneath My Wings, this is the […]

JCDecaux-Owned APN Outdoor Snags Perth Airport
  • Media

JCDecaux-Owned APN Outdoor Snags Perth Airport

APN Outdoor, now part of JCDecaux, has signed an important new agreement with Perth Airport. This rounds out its existing contract covering internal advertising in all four terminals, as well as external billboards approaching and within the Perth Airport precinct. APN Outdoor currently holds the rights to all external advertising at the Airport, along with […]

Bunnings & Esky Plus Launch Frightfully Good Summer Ad
  • Advertising
  • Campaigns

Bunnings & Esky Plus Launch Frightfully Good Summer Ad

Cooler box maker Esky together with Bunnings have launched their latest TV commercial titled ‘Prey’ with the release of the new Esky Plus. Set against a far Northern Queensland looking river backdrop, the ad features a frightfully large crocodile as it launches from the riverbed and absconds with the product. The ad, which was conceived […]

AMSRO Applauds ACCC’s Preliminary Report To Safeguard Data Privacy
  • Marketing

AMSRO Applauds ACCC’s Preliminary Report To Safeguard Data Privacy

The Association of Market and Social Research Organisations (AMSRO) today applauded the Australian Competition and Consumer Commission’s (ACCC) preliminary Digital Platforms Inquiry report and proposals to further protect the privacy of individuals across the digital landscape.

AppNexus Offers Buyers Fee-Transparent Supply-Side Platform
  • Advertising
  • Technology

AppNexus Offers Buyers Fee-Transparent Supply-Side Platform

AppNexus, a Xandr company and leader in advertising technology, has announced that agreements with many direct publishers in the AppNexus marketplace and partnerships with third-party transparency companies have facilitated one of the programmatic advertising industry’s first fee-transparent supply-side platforms (SSP), giving buyers an unprecedented level of visibility into technology fees. “Through our policies and partnerships, AppNexus […]

Aussie Adland’s Brightest Come Together To Crystal-Ball Trends In Creative & Marketing
  • Advertising
  • Marketing

Aussie Adland’s Brightest Come Together To Crystal-Ball Trends In Creative & Marketing

A new Aussie study – based on the views of some of adland’s brightest – has concluded that data and technology is bringing agency creatives and marketers far closer together. The study, titled Joining The Dots: The Future Of Creativity, was conducted by PwC and Google and included the opinions of 15 industry thought leaders […]

by B&T Magazine

B&T Magazine