Borzo (formerly WeFast), a global intra-city courier delivery service has released a marketing case study to explore the effectiveness of AI-driven advertising tools compared to those developed by human teams.
In this advertising and marketing experiment, Borzo released two sets of advertising banners on Facebook, Instagram, and Google. The first set was created entirely by three AI tools namely ChatGPT, MidJourney and DALL-E and compiled using Viewst, while the second set was developed by the Borzo’s marketing team. Both sets of banners were run parallelly over a month with a total budget of USD $19,065 (AU$28,500).
In the development of banners using AI, ChatGPT contributed copy, MidJourney and DALL-E developed creatives and final output was compiled in Viewst. The marketing team consisted of a team of copywriters and designers. The paid specialists were common for both campaigns as they optimized and evaluated the results.
The Facebook and Instagram advertising campaign showed that human-designed banners were more effective in bringing in customers, with a staggering 9.5 times more customers compared to AI-generated banners. The Customer Acquisition Cost (CAC) of AI banner ads was also 2.5 times higher than human-made banner ads. The AI banner ads had three times higher Click-through rates (CTR) compared to human-designed banner ads.
Overall it can be observed that AI-generated ads were more effective in getting attention but fell short on generating clients despite high cash burn. In comparison to this, human-designed ads drew less attention but were more effective in generating leads whilst burning less.
The Google Ads campaign showed that AI banners with text had 26 per cent lower CAC compared to human-designed banners with texts and 32 per cent better View-Through Conversion (VTC), despite the fact that AI banners showed a worse CTR.
The campaign showed that human-created campaigns took approximately three-to-four days to be ready for execution taking into account all the planning, previous task load while AI was more efficient, taking only four hours. However, using AI was a tedious task as it required 50-60 prompts to generate the final AD images. Conversely, human designs underwent very few revisions once the brief was communicated.
“We always look for innovative ways to engage our audience and this time we have taken a brave attempt at testing our marketing team by pitting them against AI,” said Devesh Gangal, country marketing manager, Borzo, India.
He also added “Through our recent advertising campaigns on Facebook, Instagram, and Google, we have discovered that while AI-generated banners may have a higher click-through rate, they are often more expensive and generate fewer leads than those created by human designers. It was also observed that the accuracy of output by AI is low compared to Human designers and most creatives generated by AI had vibrant colours instead of brand colours.
“Though AI generates more attractive and efficient images, human intervention is still required to optimize the final output. At present, AI tools are extremely useful for local entrepreneurs and Small businesses, however, bigger brands cannot completely rely on AI but can increase the pace of the entire process. Nonetheless, AI is promising and warrants further exploration. It may take more time for Meta to learn and attract clients with a low CAC for AI-generated ads, but we have not disabled campaigns on Google with AI banners and will continue to work with them. As we continue to refine our approach to online advertising, we are excited to see what the future holds for the use of AI in marketing.”
