Look Out! Here Comes The Augmented Marketing Experience!

Look Out! Here Comes The Augmented Marketing Experience!

Here, Jon Stubley (pictured below), managing director ANZ of GumGum, says augmented marketing is only just hitting its stride here in Australia and, he warns, you ain’t seen nothing yet…!

Last month, Ikea acquired online gig economy platform Task Rabbit (the US equivalent of our own Airtasker). It makes perfect sense as a move to improve the customer experience of millions of consumers who struggle to decipher their hieroglyphic-like instructions. It also makes sense in a world where customer experience is becoming the key differentiator for most organisations; retail or not.

Jon Stubley - GumGum - cropped

According to Ikea CEO Jesper Brodin, the acquisition will also enable the company to “learn from TaskRabbit’s digital expertise.”

Ikea has long been experimenting in the digital world. For example, it was an early adopter of Virtual Reality (VR), launching an Australian VR store earlier this year. However, it has recently launched a new Augmented Reality (AR) app that really gets me excited.

Ikea Place, which uses Apple’s new ARKit (the developer toolkit created to drive the augmented reality capabilities on iOS devices), will allow customers to tap through the app’s 2,000 different products, then hold up their phone and use the camera to show how the product looks in their own room. The app can even sense walls and determine how light and shadows sit on the furniture along with the ability to purchase in-app.

The app demonstrates one of the most exciting things about the new wave of augmented reality; the use of computer vision to put things in their proper context and scale them to their desired destination. It is possible thanks to recent technological advances that use computer vision to enable mobile devices to detect their position relative to the world around them.

And it’s pertinent to the media and marketing world as it can be used in anything from advertising to branding to retail to customer service.

As with the adoption of any new technology, there’s bound to be some misfire – innovation for innovation’s sake versus providing a true utility to boost the customer experience.

However, there are some interesting early examples out there which illustrate its future potential for the media and marketing industry as follows.


If you are bemused to see so many people taking photos of their food in restaurants these days, then the bad news is you will probably see more people pointing their cameras at the table.

AR start up Kabaq is aiming to transform the traditional restaurant menu by allowing diners to see 360 degrees, near photorealistic 3D images presented to scale on the plate in front of them. Check out the video to see precisely what I mean, but it’s akin to the old laminated photo menu on steroids.

From a wider marketing perspective, the company is also seeking to develop custom applications for brands. For example, consumers could point their phones at product packaging and visualise recipes made with the product – an interesting option for FMCG and supermarkets.

Finding stuff

In the US, home improvement giant, Lowes have developed Lowe’s Vision: In-Store Navigation app that lets customers use their Google Tango-enabled smartphone to search for products online, add them to a shopping list and then use their phone to find the products they need inside the store.

Here the excitement is in the ‘what if’. The reality is that there are hardly any smartphones with Tango incorporated as it requires hardware that is pretty expensive (to resolve this issue, Google have recently introduced a ARCore – its answer to ARKit so it can bring augmented reality experiences to other phones without requiring the hardware).

However, going forward we are likely to see brands using this type of functionality both inside and outside of the physical store. For example, theoretically you could use it in busy urban areas and point your phone to find your favourite artisanal coffee or kombucha.


The beauty industry is a natural fit for augmented reality apps and they have been early adopters and experimenters. Makeup mega-store Sephora introduced its Virtual Artist iOS app earlier this year. It scans your face, locates your eyes and lips, and lets you try on different looks. The app also offers virtual tutorials to demonstrate how to do things like contour and apply eyeliner virtually, right on their faces.

L’Oréal also has several branded AR apps (Makeup Genius, Style My Hair) that let users apply makeup and hair looks to their selfies before trying a product. Outside of providing utility to consumers, it uses the data to find out what customers like and don’t like.

It is still early days, but as technologies like ARKit and ARCore continue to mature, we will absolutely see AR become increasingly integral to marketing and advertising campaigns. The trick will be to create an experience that provides genuine utility and engagement for the consumer.


Please login with linkedin to comment

gumgum jon stubley

Latest News

“Simply Disingenuous!” Coles Challenged Over Its Decision To Phase Out Its Printed Catalogue
  • Marketing

“Simply Disingenuous!” Coles Challenged Over Its Decision To Phase Out Its Printed Catalogue

The Real Media Collective (TRMC), the Australian industry association representing the interests of companies in the paper, print, publishing/media and related distribution sectors across Australia, has challenged Coles Supermarkets for using the environment as a reason in its announcement today outlining its plans to cease sending catalogues to Australian homes from September. In the announcement, […]

Major Stars Including Kerri-Anne Kennerley & Tim Bailey To Go As 10 Announces Major Restructure
  • Media

Major Stars Including Kerri-Anne Kennerley & Tim Bailey To Go As 10 Announces Major Restructure

Network 10 is set to undergo a massive restructure, leaving a number of high-profile journalists out of a job, including Kerri-Anne Kennerley, Natarsha Belling and Tim Bailey, B&T understands. As first reported on The Sydney Morning Herald, the restructure was announced to staff on Tuesday. As part of the restructuring, the presentation of the weekday […]

by B&T Magazine

B&T Magazine
The Alcohol & Drug Foundation Team With Dee Madigan’s Campaign Edge To Tackle CV-19 Drinking
  • Campaigns

The Alcohol & Drug Foundation Team With Dee Madigan’s Campaign Edge To Tackle CV-19 Drinking

Alcohol & Drug Foundation (ADF) has launched a new national health campaign with Campaign Edge aiming to tackle COVID-19 drinking. Funded by the Australian Government, Break the Habit reveals that it takes only around 66 days to form a habit – roughly the same amount of time many Australians spent in lockdown. It’s a fact most Aussies are […]

How To Get Out Of A Cashflow Crisis
  • Opinion

How To Get Out Of A Cashflow Crisis

Paul Roach (pictured below) is a business strategist and coach who has worked with hundreds of SMEs across many industries to supercharge their cashflow. Roach is also author of the book Smarter Business Stronger Cashflow. In this guest post, Roach gives his top tips when the cash taps start to be turned off… Cashflow is like […]

One Daydream Expands Into Alcohol Category
  • Marketing

One Daydream Expands Into Alcohol Category

Sydney and Melbourne based PR, Talent & Digital agency One Daydream has extended its client portfolio to include alcohol. The category expansion comes as One Daydream joins the agency roster of Pernod Ricard, working on a project basis to manage strategic PR and digital campaigns. The global drinks group boasts one of the most comprehensive and prestigious […]

Modern interior with furniture and creative business sketch on wall. Success and solution concept. 3D Rendering
  • Media

Commtract Appoints New Business Development GM

Commtract today expanded its marketing, advertising and digital offering in response to a growing number of CEOs outsourcing to ‘gig-workers’ amid COVID-19. According to new research, 40 per cent of Australian CEOs are planning on outsourcing to freelancers in the contingent workforce. Commtract, which launched in 2016,  has more than 4,000 communications experts on its platform, and has already placed over 800 roles. […]