Five Ways Computer Vision Is In (Or Soon Will Be) Your Everyday Life (Including The Ads You Make)

Five Ways Computer Vision Is In (Or Soon Will Be) Your Everyday Life (Including The Ads You Make)
SHARE
THIS



In his latest guest post, managing director of GumGum, Jon Stubley (pictured below), takes a look at computer vision and the impacts it’s already having on peoples’ lives. And that includes making better ads, too…

Last year’s launch of the iPhone X introduced millions of people to the concept of computer vision. They might not know the actual term for it (or the specifics of how it works) but they’d be aware that the new model phone ‘recognises’ faces as part of its Face ID sensor system due to clever technology that is able to make sense of what it sees.

Jon Stubley

What less people are aware of, however, is how much computer vision is already beginning to impact their lives (regardless of whether they have stumped up over $1000 for the iPhone X) – and its impact is only going to accelerate.

Fashion forward

Computer vision designed clothes have yet to hit the aisles of K-Mart – but it is only a matter of time. During Melbourne Spring Fashion Week 2016, Couture designer Jason Grech worked with IBM Watson to understand the latest runway trends and designed a 12-piece collection called, ‘Cognitive Couture.’ Whilst undoubtedly a marketing stunt, it demonstrates how computer vision can be used in the retail fashion sector – in this instance analysing ten years of runway fashion and social media buzz to help the designer and his team explore and evaluate trends, colours and textures during the creative process.

Sporting highlights

Another IBM Watson powered initiative was used during the recent US Open Tennis Championships, when the United States Tennis Association (USTA) used Watson Media to automatically generate match highlights to be shared through social media. The machine analysed images and video, as well as language, sentiment and tone – for example, sounds from the crowd that signalled something special was happening on court, but also footage of winning plays, victory-like actions such as fist pumps by players, and facial expressions. I expect to see more large scale televised events using this technology going forward – it is able to manage raw video footage in near real-time and make the seemingly impossible very much achievable.

Pocket movies

Enabled by the aforementioned iPhone X, University of Sydney doctoral student Mia Harrison and her colleagues released a short video set to the Queen classic “Bohemian Rhapsody” and starring animated iPhone X emoji using the iPhone’s  “Animoji” feature. The feature enables the phone’s camera can capture your facial muscle movements using computer vision and then transposes them into facial expressions of animated emoji. This makes tech that was previously in the realms of the big move studios accessible to all – it is quite literally in your pocket. Animoji leverages the power of the iPhone X’s A9 processor and Apple’s ARKit (Augmented Reality Kit) software framework. (Google has a competing framework for Android called ARCore.) Incidentally, Mia Harrison’s work caught the attention of famed tech writer and former Wall Street Journal and Recode columnist who tweeted, “Genius iPhone X creation! And it’s only been out a couple of weeks. Watch this (or any of the thousands of other animoji karaoke videos that have already cropped up online) and imagine what’s coming with this technology.”

Reducing crime

For some it’s a little too Big Brother-ish but the European Commission partly funded a trial to develop a computer vision system that detects suspicious behaviour in CCTV footage as it happens.  The P-React project aimed to help catch criminals in the act and flag the relevant video clips to authorities. According to The New Scientist, the algorithms have been taught to highlight atypical behaviour and have been trained on example scenes of people fighting and people chasing someone who has snatched a bag. It promises to help with digital overload for the police – in cities there are so many CCTV cameras it can be hard to pinpoint the footage that has value for investigations and prosecutions.

Better ads and better insights

Computer vision is also helping making the ads we see more relevant – in a number of ways. Firstly, it is behind the ads that my own company enable – contextual ads that appear within or around editorial images on a page and that don’t interrupt the consumer on the page (they are CBA compliant). The tech is driven by computer vision that scans images, videos and the context around them – so an editorial image of a blonde film actress becomes a place for a shampoo formulated for blonde hair to be.  Computer vision is also being used to better find out how consumers are actually responding to a new advert.  Affectiva, an outgrowth of the MIT Media Lab, helps brands (including Mars, Kellogg’s and CBS) use computer vision and deep learning algorithms to make sense of viewer facial reactions as they watch content via its Emotion SDK (software development kit) that works across mobile devices and standard desktop webcams.

The integration of computer vision into all aspects of our day to day lives is sky rocketing. For marketers and publishers, it opens up a host of possibility that should be given careful consideration as the technology rapidly matures.

Please login with linkedin to comment

gumgum jon stubley

Latest News

MediaCom Exec Says “We Need To Stop Looking At The World Through A Man’s Eyes”
  • Media

MediaCom Exec Says “We Need To Stop Looking At The World Through A Man’s Eyes”

As you should very well know, our Women in Media Awards are fast approaching – in fact, they’re only a month away! To celebrate this wonderful fact, and to get you excited to celebrate the inspiring women in this industry, we’ve spoken to one of the most diverse companies we could think of. An impressive […]

by B&T Magazine

B&T Magazine
Reports: Ten Set To Hand Disgraced Pollie Sam Dastyari His Own Panel Show
  • Media

Reports: Ten Set To Hand Disgraced Pollie Sam Dastyari His Own Panel Show

After yesterday’s news that Kyle Sandilands had agreed to head back to Network Ten for a new Judge Judy-esque show, it now appears rumours that disgraced Labor politician Sam Dastyari has signed with the network appear true, too. News Corp websites have today confirmed rumours Dastyari will front a new scandal-come-current affairs program to be called […]

by B&T Magazine

B&T Magazine
JWT Wins Creative Duties For Coles’ Vintage Cellars & First Choice Liquor
  • Advertising

JWT Wins Creative Duties For Coles’ Vintage Cellars & First Choice Liquor

J. Walter Thompson has been appointed as the lead creative agency for the Coles Liquor’s Vintage Cellars and First Choice Liquor brands, following a hotly-contested pitch involving several Melbourne-based agencies. Michael Godwin (pictured above), managing director at JWT Melbourne, said: “We’re thrilled to be working with the Coles Liquor team on these two brands and […]

Spark Foundry Scoops Up $10m Media Account For Peters Ice Cream
  • Advertising
  • Media

Spark Foundry Scoops Up $10m Media Account For Peters Ice Cream

Iconic ice cream company Peters Ice Cream is continuing its longstanding partnership with Publicis Media, appointing Spark Foundry to its media account. Zenith was the incumbent on the $10 million account, and B&T understands Initiative was also involved in the pitch process. Peters was established in Australia in 1907 by Fred Peters and its brands include […]

Australian Defence Force Celebrates NAIDOC Week Via The Story Lab & Cox Inall Change
  • Campaigns
  • Marketing

Australian Defence Force Celebrates NAIDOC Week Via The Story Lab & Cox Inall Change

Dentsu Aegis Network agencies Cox Inall Change and The Story Lab, have partnered with the Australian Defence Force (ADF) to create and promote video content for its Indigenous development programs. Following six months of documentary-style coverage, charting the highs and lows of recruits across three programs, the content was released to celebrate NAIDOC Week, as […]

Youngbloods Launches ‘Innovate Or Die’ Event In Partnership With General Assembly
  • Advertising
  • Marketing
  • Media

Youngbloods Launches ‘Innovate Or Die’ Event In Partnership With General Assembly

Youngbloods NSW has launched its August panel event, which will see six industry leaders discuss how innovation is transforming the industry. The event will take place General Assembly’s HQ on Wednesday 1 August at 7pm. Tickets (which you can purchase here) are $20 and include booze and pizza. The line-up of speakers for the event […]

Masculinity Roasted In Clever New Ad
  • Advertising
  • Campaigns

Masculinity Roasted In Clever New Ad

Think masculinity means drinking a case without chundering? Well, rediscover it (& possibly yourself) with this top ad.

by B&T Magazine

B&T Magazine
WPP AUNZ Partners With Career Trackers Indigenous Internship Program
  • Advertising

WPP AUNZ Partners With Career Trackers Indigenous Internship Program

Advertising and marketing network WPP AUNZ has joined the Career Trackers Indigenous Internship Program as part of its commitment to a diverse workforce, and the creation of opportunities that inspire excellence. As part of the program, WPP AUNZ has welcomed its first three interns: Abi-Leigh Dillon (WPP AUNZ), Amy Mccutcheon (MediaCom) and Jacinta Evans (Ogilvy), […]

Taboo Goes On A Hiring Spree
  • Advertising

Taboo Goes On A Hiring Spree

Taboo has gone a hiring spree. And when it comes to sprees, that's far better than a shooting one or a farting one.

Luke Kelly Becomes A Partner At HBT
  • Advertising
  • Marketing
  • Technology

Luke Kelly Becomes A Partner At HBT

B&T's not sure what's with that twirly thing in the press photo, suffice to say a vortex to an alternate dimension?

Women In Media Profile: Alison Michalk
  • Media

Women In Media Profile: Alison Michalk

If B&T's Women in Media profiles were an animal they would be a gazelle or lioness, or even a lioness eating a gazelle.

by B&T Magazine

B&T Magazine
Grant Broadcasters Makes Several Changes To Senior Executive Team
  • Media

Grant Broadcasters Makes Several Changes To Senior Executive Team

Independent media company Grant Broadcasters has announced a number of changes to its executive ranks. Grant Cameron will move up to become non-executive chairman for the company, and Alison Cameron (pictured above) – currently the chief operating officer – will assume the CEO role. Dugald Cameron remains responsible for the family’s investment portfolio and is […]

Shopper Media Group Partners With Mist To Offer New Tech & AI-Driven Capabilities
  • Advertising
  • Media

Shopper Media Group Partners With Mist To Offer New Tech & AI-Driven Capabilities

Australian retail out-of-home (OOH) business Shopper Media Group (SMG) has announced a partnership with AI-powered wireless networks provider Mist. The partnership will see SMG offer new WiFi, analytics and location-based services across the company’s portfolio of Australian shopping centres. Mist currently provides WiFi and location services using virtual Bluetooth LE technology to businesses across all […]

Indy Agency This Is Flow Wins Cruiseco’s $5 Million Media Account
  • Advertising
  • Media

Indy Agency This Is Flow Wins Cruiseco’s $5 Million Media Account

Travel organisation Cruiseco has announced the appointment of Sydney independent agency This is Flow (TIF) to handle its $5 million media account. This is the first time Cruiseco has appointed an agency, having managed its communications internally. Cruiseco is the largest and broadest distributor of cruise products in the Southern Hemisphere. With a membership base […]

Women In Media Profile: Naomi Shepherd
  • Media

Women In Media Profile: Naomi Shepherd

Need a Monday morning pick-me-up? You could stand naked next to the office fridge or read these inspiring words.

by B&T Magazine

B&T Magazine
APN Outdoor Takes Off With Queenstown Airport Contract
  • Advertising
  • Media

APN Outdoor Takes Off With Queenstown Airport Contract

Out-of-home media business APN Outdoor has won the tender for New Zealand’s Queenstown Airport. As part of the new agreement, APN Outdoor has flagged extensive development plans for Queenstown Airport’s advertising assets. The new contract adds Queenstown Airport to APN Outdoor’s existing portfolio of Auckland and Christchurch Airports. The media company will hire a South […]

Havas Secures Exclusive ‘Fight Of Champions’ Broadcast Rights With Foxtel For Australia & NZ
  • Media

Havas Secures Exclusive ‘Fight Of Champions’ Broadcast Rights With Foxtel For Australia & NZ

Havas Sports & Entertainment ANZ, a division of the broader global full-service agency Havas, has confirmed an exclusive deal with Foxtel to showcase the World Boxing Association (WBA) Welterweight Championship across the trans-Tasman. Billed as the ‘Fight of Champions’, Manny Pacquiao and Lucas Matthysse will square off for the WBA Welterweight belt this Sunday. Havas […]

The Question On Everybody’s Lips At Cannes: How Did Tesco Win The Grand Prix Media Lion?
  • Media
  • Opinion

The Question On Everybody’s Lips At Cannes: How Did Tesco Win The Grand Prix Media Lion?

In this guest post, PHD’s Chloe Hooper (pictured below) analyses the campaign that claimed top honours in the Media category at Cannes this year. I sat in the auditorium as the Cannes Media Lion winners for 2018 were awarded. One thing became instantly clear to me: it is all about taking home Gold or the Grand Prix. […]

Opinion

by B&T Magazine

B&T Magazine
MINI Australia Showcases New ‘Connected’ Vehicles Via Vizeum & Posterscope
  • Advertising
  • Campaigns

MINI Australia Showcases New ‘Connected’ Vehicles Via Vizeum & Posterscope

An integrated campaign by Vizeum Melbourne for MINI Australia’s new ‘Connected’ vehicles will see digital out-of-home (DOOH) served via Posterscope’s Liveposter platform. Delivered centrally, the campaign will showcase the flexible qualities DOOH provides via multiple creatives targeted with specific data overlays such as location, traffic, time of day, and weather triggers such as rain. The […]

Women In Media Profile: Lisa Sheehan
  • Media

Women In Media Profile: Lisa Sheehan

The delightful Lisa Sheehan straps into B&T's "cage of truth" we actually prefer to call our Women in Media profiles.

by B&T Magazine

B&T Magazine