Five Ways Computer Vision Is In (Or Soon Will Be) Your Everyday Life (Including The Ads You Make)

Five Ways Computer Vision Is In (Or Soon Will Be) Your Everyday Life (Including The Ads You Make)
SHARE
THIS



In his latest guest post, managing director of GumGum, Jon Stubley (pictured below), takes a look at computer vision and the impacts it’s already having on peoples’ lives. And that includes making better ads, too…

Last year’s launch of the iPhone X introduced millions of people to the concept of computer vision. They might not know the actual term for it (or the specifics of how it works) but they’d be aware that the new model phone ‘recognises’ faces as part of its Face ID sensor system due to clever technology that is able to make sense of what it sees.

Jon Stubley

What less people are aware of, however, is how much computer vision is already beginning to impact their lives (regardless of whether they have stumped up over $1000 for the iPhone X) – and its impact is only going to accelerate.

Fashion forward

Computer vision designed clothes have yet to hit the aisles of K-Mart – but it is only a matter of time. During Melbourne Spring Fashion Week 2016, Couture designer Jason Grech worked with IBM Watson to understand the latest runway trends and designed a 12-piece collection called, ‘Cognitive Couture.’ Whilst undoubtedly a marketing stunt, it demonstrates how computer vision can be used in the retail fashion sector – in this instance analysing ten years of runway fashion and social media buzz to help the designer and his team explore and evaluate trends, colours and textures during the creative process.

Sporting highlights

Another IBM Watson powered initiative was used during the recent US Open Tennis Championships, when the United States Tennis Association (USTA) used Watson Media to automatically generate match highlights to be shared through social media. The machine analysed images and video, as well as language, sentiment and tone – for example, sounds from the crowd that signalled something special was happening on court, but also footage of winning plays, victory-like actions such as fist pumps by players, and facial expressions. I expect to see more large scale televised events using this technology going forward – it is able to manage raw video footage in near real-time and make the seemingly impossible very much achievable.

Pocket movies

Enabled by the aforementioned iPhone X, University of Sydney doctoral student Mia Harrison and her colleagues released a short video set to the Queen classic “Bohemian Rhapsody” and starring animated iPhone X emoji using the iPhone’s  “Animoji” feature. The feature enables the phone’s camera can capture your facial muscle movements using computer vision and then transposes them into facial expressions of animated emoji. This makes tech that was previously in the realms of the big move studios accessible to all – it is quite literally in your pocket. Animoji leverages the power of the iPhone X’s A9 processor and Apple’s ARKit (Augmented Reality Kit) software framework. (Google has a competing framework for Android called ARCore.) Incidentally, Mia Harrison’s work caught the attention of famed tech writer and former Wall Street Journal and Recode columnist who tweeted, “Genius iPhone X creation! And it’s only been out a couple of weeks. Watch this (or any of the thousands of other animoji karaoke videos that have already cropped up online) and imagine what’s coming with this technology.”

Reducing crime

For some it’s a little too Big Brother-ish but the European Commission partly funded a trial to develop a computer vision system that detects suspicious behaviour in CCTV footage as it happens.  The P-React project aimed to help catch criminals in the act and flag the relevant video clips to authorities. According to The New Scientist, the algorithms have been taught to highlight atypical behaviour and have been trained on example scenes of people fighting and people chasing someone who has snatched a bag. It promises to help with digital overload for the police – in cities there are so many CCTV cameras it can be hard to pinpoint the footage that has value for investigations and prosecutions.

Better ads and better insights

Computer vision is also helping making the ads we see more relevant – in a number of ways. Firstly, it is behind the ads that my own company enable – contextual ads that appear within or around editorial images on a page and that don’t interrupt the consumer on the page (they are CBA compliant). The tech is driven by computer vision that scans images, videos and the context around them – so an editorial image of a blonde film actress becomes a place for a shampoo formulated for blonde hair to be.  Computer vision is also being used to better find out how consumers are actually responding to a new advert.  Affectiva, an outgrowth of the MIT Media Lab, helps brands (including Mars, Kellogg’s and CBS) use computer vision and deep learning algorithms to make sense of viewer facial reactions as they watch content via its Emotion SDK (software development kit) that works across mobile devices and standard desktop webcams.

The integration of computer vision into all aspects of our day to day lives is sky rocketing. For marketers and publishers, it opens up a host of possibility that should be given careful consideration as the technology rapidly matures.

Please login with linkedin to comment

gumgum jon stubley

Latest News

AUSTIN, TEXAS - JUNE 18: (EDITORIAL USE ONLY) (Editors note: This image was computer generated in-game) Alice Powell of Great Britain celebrates her podium position during the W Series Esport League Round 2 at Circuit of The Americas on June 18, 2020 in Austin, United States. (Photo by Clive Rose/Getty Images)
  • Media

Getty Images Inks Deal With W Series Esports League

Getty Images and W Series have announced an exclusive deal which sees Getty Images serve as the Official Photographic Partner of the newly launched W Series Esports League. Brand-new for 2020, the W Series Esports League will see W Series drivers from around the world compete in the first official women only simulated racing league. […]

Closeup of a man hand holding cellphone with internet browser on screen. Man with spectacles relaxing sitting on couch while looking at mobile phone. Closeup of mature latin man using smartphone to checking email at home.
  • Technology

What’s Next For Advertising On iPhones?

Wondering what's next for advertising on iPhones? You could give Tim Cook a call or, failing him answering, read this.

by B&T Magazine

B&T Magazine
FutureBrand Australia CEO Rich Curtis Acquires The Global Branding Company’s Australian Operations
  • Media

FutureBrand Australia CEO Rich Curtis Acquires The Global Branding Company’s Australian Operations

Rich Curtis has acquired FutureBrand’s Australian operations from Interpublic Group. The new ownership will enable the business to double-down on its commitment to the Australian market and invest locally, while still maintaining its global network via FutureBrand as an affiliate. Since opening its doors in 1999, FutureBrand has created and transformed iconic brands including Nespresso, […]

Newsreader Katrina Blowers Launches Claiming Your Confidence, The Podcast
  • Media

Newsreader Katrina Blowers Launches Claiming Your Confidence, The Podcast

Big names share their biggest confidence challenges on Claiming Your Confidence, The Podcast, hosted by Channel Seven Newsreader and author Katrina Blowers. The new show launches July 13 on iTunes and Spotify with three episodes dropping on week one:  featuring Sunrise Host Edwina Bartholemew, Comedian Merrick Watts and record-breaking Ultra Runner Jacqui Bell. Each week […]

Production house Sam I Am Steps Up Roster With Five Fresh Directors
  • Media

Production house Sam I Am Steps Up Roster With Five Fresh Directors

Full service production house Sam I Am has announced the arrival of five new commercial directors including writer-director Aimée-Lee Xu Hsien Curran (pictured), designer-turned-director Sinéad McDevitt along with directors Anita Lee, Dominic Allen and Joris Noordenbos. Writer-director Aimée-Lee Xu Hsien Curran creates work defined by rich visuals across both comedy and drama. She has directed […]

DiDi Partners With Urban List For Make It A Date Campaign
  • Campaigns

DiDi Partners With Urban List For Make It A Date Campaign

DiDi Australia has partnered with lifestyle publisher Urban List for its Make It A Date campaign, encouraging Australians to reconnect and commit to meaningful time with one another as COVID-19 restrictions lift across cities. The collaboration sees Urban List provide curated in-app destinations and venue recommendations to inspire Aussies to ‘make it a date’ and […]

Archetype Appointed By HTC, Tile And Upright Technologies
  • Media

Archetype Appointed By HTC, Tile And Upright Technologies

Strategic communications and marketing agency, Archetype, has been appointed by HTC, Tile and Upright Technologies to drive awareness and sales for each brand’s consumer technology products. The agency has put its strategic and holistic thinking first, evolving the approach to market for all three product offerings. The new additions to Archetype’s portfolio showcase the agency’s […]

Wrike Introduces New Marketing Tool
  • Technology

Wrike Introduces New Marketing Tool

Wrike unveils new marketing tool that apparently comes wrapped in excess bubble wrap for those who enjoy a good popping.

Music online concept - phablet and headphones on the wooden desk
  • Media

SCA’s Live Radio Streaming Audience Up 35% Year On Year

SCA’s live radio streaming continues to rise with 1.1million listeners recorded at the end of June 2020, up 35 per cent year on year. Catch up radio podcasts continue to be on trend with a total of 3.2 million downloads recorded at the end of June, this is a 49 per cent year on year […]

SWM Enhances Audience Intelligence With New Location Data Partner
  • Media

SWM Enhances Audience Intelligence With New Location Data Partner

Seven West Media has enhanced its audience intelligence offering for advertisers thanks to a new partnership with Australian mobile location intelligence platform LANDMARKS ID. LANDMARKS ID enables SWM to integrate its technology directly into the 7plus app to collect, analyse and provide rich audience profiles on 7plus app users. The new partnership improves SWM’s ability […]