Five Ways Computer Vision Is In (Or Soon Will Be) Your Everyday Life (Including The Ads You Make)

Five Ways Computer Vision Is In (Or Soon Will Be) Your Everyday Life (Including The Ads You Make)
SHARE
THIS



In his latest guest post, managing director of GumGum, Jon Stubley (pictured below), takes a look at computer vision and the impacts it’s already having on peoples’ lives. And that includes making better ads, too…

Last year’s launch of the iPhone X introduced millions of people to the concept of computer vision. They might not know the actual term for it (or the specifics of how it works) but they’d be aware that the new model phone ‘recognises’ faces as part of its Face ID sensor system due to clever technology that is able to make sense of what it sees.

Jon Stubley

What less people are aware of, however, is how much computer vision is already beginning to impact their lives (regardless of whether they have stumped up over $1000 for the iPhone X) – and its impact is only going to accelerate.

Fashion forward

Computer vision designed clothes have yet to hit the aisles of K-Mart – but it is only a matter of time. During Melbourne Spring Fashion Week 2016, Couture designer Jason Grech worked with IBM Watson to understand the latest runway trends and designed a 12-piece collection called, ‘Cognitive Couture.’ Whilst undoubtedly a marketing stunt, it demonstrates how computer vision can be used in the retail fashion sector – in this instance analysing ten years of runway fashion and social media buzz to help the designer and his team explore and evaluate trends, colours and textures during the creative process.

Sporting highlights

Another IBM Watson powered initiative was used during the recent US Open Tennis Championships, when the United States Tennis Association (USTA) used Watson Media to automatically generate match highlights to be shared through social media. The machine analysed images and video, as well as language, sentiment and tone – for example, sounds from the crowd that signalled something special was happening on court, but also footage of winning plays, victory-like actions such as fist pumps by players, and facial expressions. I expect to see more large scale televised events using this technology going forward – it is able to manage raw video footage in near real-time and make the seemingly impossible very much achievable.

Pocket movies

Enabled by the aforementioned iPhone X, University of Sydney doctoral student Mia Harrison and her colleagues released a short video set to the Queen classic “Bohemian Rhapsody” and starring animated iPhone X emoji using the iPhone’s  “Animoji” feature. The feature enables the phone’s camera can capture your facial muscle movements using computer vision and then transposes them into facial expressions of animated emoji. This makes tech that was previously in the realms of the big move studios accessible to all – it is quite literally in your pocket. Animoji leverages the power of the iPhone X’s A9 processor and Apple’s ARKit (Augmented Reality Kit) software framework. (Google has a competing framework for Android called ARCore.) Incidentally, Mia Harrison’s work caught the attention of famed tech writer and former Wall Street Journal and Recode columnist who tweeted, “Genius iPhone X creation! And it’s only been out a couple of weeks. Watch this (or any of the thousands of other animoji karaoke videos that have already cropped up online) and imagine what’s coming with this technology.”

Reducing crime

For some it’s a little too Big Brother-ish but the European Commission partly funded a trial to develop a computer vision system that detects suspicious behaviour in CCTV footage as it happens.  The P-React project aimed to help catch criminals in the act and flag the relevant video clips to authorities. According to The New Scientist, the algorithms have been taught to highlight atypical behaviour and have been trained on example scenes of people fighting and people chasing someone who has snatched a bag. It promises to help with digital overload for the police – in cities there are so many CCTV cameras it can be hard to pinpoint the footage that has value for investigations and prosecutions.

Better ads and better insights

Computer vision is also helping making the ads we see more relevant – in a number of ways. Firstly, it is behind the ads that my own company enable – contextual ads that appear within or around editorial images on a page and that don’t interrupt the consumer on the page (they are CBA compliant). The tech is driven by computer vision that scans images, videos and the context around them – so an editorial image of a blonde film actress becomes a place for a shampoo formulated for blonde hair to be.  Computer vision is also being used to better find out how consumers are actually responding to a new advert.  Affectiva, an outgrowth of the MIT Media Lab, helps brands (including Mars, Kellogg’s and CBS) use computer vision and deep learning algorithms to make sense of viewer facial reactions as they watch content via its Emotion SDK (software development kit) that works across mobile devices and standard desktop webcams.

The integration of computer vision into all aspects of our day to day lives is sky rocketing. For marketers and publishers, it opens up a host of possibility that should be given careful consideration as the technology rapidly matures.

Please login with linkedin to comment

gumgum jon stubley

Latest News

Rakuten Marketing Launches Consent Management Platform In Line With GDPR
  • Marketing

Rakuten Marketing Launches Consent Management Platform In Line With GDPR

Performance marketing company Rakuten Marketing has unveiled a new consent management platform (CMP) for retailers, advertisers and publishers. Compliant with the IAB Europe/Tech Lab Transparency and Consent Framework and developed to-date within a DigiTrust (now IAB Tech Lab) working group, the CMP is a proactive measure to help retailers, advertisers and publishers gain consent under […]

Five Top Tips To Improve Your UX And SEO
  • Opinion

Five Top Tips To Improve Your UX And SEO

Is your UX & SEO performing like a brattish MAFS contestant? Well, let this be the penetrative lube to their love woes.

Opinion

by B&T Magazine

B&T Magazine
Marc Edward Agency Snares PR Account For Cruiseco Australia
  • Marketing

Marc Edward Agency Snares PR Account For Cruiseco Australia

Experiential marketing firm Marc Edward Agency (MEA) announced the addition of Cruiseco Australia as client for its communications division. Following on from its execution of the Cruiseco 17th Annual Conference in Brisbane earlier this year, MEA has been appointed as the cruise specialist’s PR agency of record. Cruiseco CEO Amanda McClelland said: “Having demonstrated their […]

Why All Email Should Be Mobile First
  • Opinion

Why All Email Should Be Mobile First

Here's an authoritative article on email and mobile, and be safe in the knowledge it wasn't penned by any B&T staff.

Opinion

by B&T Magazine

B&T Magazine
39th AWARD Awards Winners Announced
  • Media

39th AWARD Awards Winners Announced

B&T was a lucky guest at the AWARD Awards last Friday, although misread the bit about fancy dress & went as a chicken.

Women In Media Profile: Zeina Khodr
  • Media

Women In Media Profile: Zeina Khodr

When B&T was offered to interview a lady named “Zeina”, we initially thought it was the warrior princess herself.

by B&T Magazine

B&T Magazine
Q&A With Cannes Chairman Terry Savage
  • Advertising
  • Media

Q&A With Cannes Chairman Terry Savage

If you mistakenly thought this was an interview with Kojak's Telly Savalas, as it turns out, it's even better than that.

Optus To Phase Out Virgin Mobile Brand
  • Marketing

Optus To Phase Out Virgin Mobile Brand

Didn't much fancy that Telstra story above? Well, perhaps B&T could tempt you with this tasty Optus tickler instead.

by B&T Magazine

B&T Magazine
AKQA R&D Teams Up With Google For Semi Permanent 2018
  • Media

AKQA R&D Teams Up With Google For Semi Permanent 2018

AKQA R&D in collaboration with Google has developed a process called Somesthetic Transfer. It uses machine learning to take both the style and texture of an artwork and apply it to another image to be 3D printed with a UV printer. The works will be displayed at Semi Permanent 2018 in Sydney from Thursday 24 […]

WPP’s Health & Wellness To Unveil ‘How Design Can Save A Life” For Vivid
  • Marketing
  • Media

WPP’s Health & Wellness To Unveil ‘How Design Can Save A Life” For Vivid

Design students from Torrens University’s Billy Blue College of Design have partnered with WPP AUNZ’s Health & Wellness division to decode clinical data on ‘Medicinal Marijuana in the Treatment of Epilepsy’. Their creative solutions will be presented at a Vivid Ideas Exchange titled ‘Design can save your life: how can creativity improve comprehension of health data?’ […]

Diversity Case Study Series: The Royals
  • Advertising
  • Marketing
  • Media

Diversity Case Study Series: The Royals

If you read one diversity case study on B&T today, make it this one. Not that there's any others to choose from, really.

by B&T Magazine

B&T Magazine
Cricket Australia Finds New Major Sponsor
  • Marketing

Cricket Australia Finds New Major Sponsor

B&T was going to insert a homage to Sherbert's classic "Howzat" here before realising it was naff and showed our age.

by B&T Magazine

B&T Magazine
PHD Wins HSBC Global Media Account
  • Media

PHD Wins HSBC Global Media Account

ICYMI, PHD has FTW the HSBC business IRL. It's not so much a LOL or NSFW, but a TL;DR. Ahh, forget the whole thing.

InMoment Accelerates APAC Expansion With Key Acquisition
  • Media

InMoment Accelerates APAC Expansion With Key Acquisition

Customer experience (CX) intelligence platform, InMoment, has expanded into Australia and New Zealand with the acquisition of customer experience agency, brandXP and appointment of Claire Fastier as its APAC business head.

Marketers Need To Focus On Voice Search Right Now
  • Opinion

Marketers Need To Focus On Voice Search Right Now

In this opinion piece, Performics Australia performance content account director Steve Robinson (pictured below) dives into the hazy relationship between marketers and voice-activated technology. From settling family disputes, (“Hey Google, are fossil fuels really made from dinosaur bones?”) to running a household, (“OK Google, add toothpaste to my shopping list”), voice-activated systems are becoming more […]

Opinion

by B&T Magazine

B&T Magazine
SpotX Launches Online Resource Library For Publishers Seeking GDPR Guidance
  • Advertising
  • Media

SpotX Launches Online Resource Library For Publishers Seeking GDPR Guidance

Video advertising and monetisation platform SpotX has announced the launch of an online resource library for the European Union’s General Data Protection Regulation (GDPR). The library can be found on the company’s website and is part of a wider educational initiative by SpotX – which is headquartered in the US and has an office in […]

Daylight Agency Opens Government Division, Hires Legal & Political Expert
  • Marketing

Daylight Agency Opens Government Division, Hires Legal & Political Expert

Integrated communications firm Daylight Agency has cemented its presence in the government and political arena with the appointment of industry veteran David Begg. A practising solicitor for over 28 years, Begg (pictured above) will head up the agency’s new government division. He has extensive experience working with large commercial clients on high-profile regulatory and legal […]

Frost Design Unveils New Look For John Holland
  • Marketing

Frost Design Unveils New Look For John Holland

Frost Design has shown off its comprehensive rebrand of iconic Australian infrastructure and property business John Holland, based around the brand idea of ‘Transforming Lives’. John Holland CEO Joe Barr said Frost was the only branding business who understood that the impact of the rebrand was just as important internally as it would be externally, […]

Women In Media Profile: Jill Johnston
  • Media

Women In Media Profile: Jill Johnston

We've got an absolute cracking Women in Media profile today. Not to say it's approved by the Chiropractors' Association.

by B&T Magazine

B&T Magazine
First Lady Michelle Obama and President Barack Obama Dance Together at the Presidents Ball
  • Media

Netflix Secures Producer Deal With The Obamas

It seems former US president Barack Obama and former First Lady Michelle Obama aren’t quite done with the international spotlight just yet. The Obamas have officially signed a multiyear deal with Netflix, which will see the power couple producing films and series with the streaming giant. According to Netflix, “The Obamas will produce a diverse […]

How To Spot A Trend Versus A Fad
  • Opinion

How To Spot A Trend Versus A Fad

One need only view our editor's hot pink leg warmers today to realise he's neither fad nor trend.

Opinion

by B&T Magazine

B&T Magazine
Why Engagement Is The New Rule Of Content
  • Opinion

Why Engagement Is The New Rule Of Content

And why is B&T running a photo of an engaged couple for this content engagement article? It was either that or a carrot.

Opinion

by B&T Magazine

B&T Magazine
Fairfax Media Recruits 20 Trainee Journalists Across All Its Titles
  • Media

Fairfax Media Recruits 20 Trainee Journalists Across All Its Titles

Fairfax Media has today announced the recruitment of 20 trainee journalists to join the newsrooms of The Sydney Morning Herald, The Age, The Canberra Times, The Australian Financial Review, Brisbane Times and WAtoday. This represents one of Metro’s largest trainee intakes in years and underlines the commitment of the mastheads to fostering a new generation […]

Sydney Australia - November 7, 2011. An extreme close up of an American express card issued by the Australian bank Westpac.
  • Media

AMEX Launches Global Media Review

Are there not enough hours in the day? Are you cheek-by-jowl with your co-workers? Well, hopefully you won't win this.