Report • 28.06.2022

Visual search – Finding products with images

Not only the result, but also the user experience is crucial

In online retail, a well-developed and easy-to-use product search is essential for customers. For a high level of convenience and optimal results, this now includes visual search. This means that users can search for similar items using images of clothing, for example.

I tested four apps from the following fashion providers for this function:

  • European clothing company C&A
  • German fashion mail order company Bonprix
  • Swedish clothing retailer H&M
  • British fashion mail order company ASOS

In all of these apps, users can upload pictures from the device's database to the search function or take pictures themselves with the camera to search for similar products.

Two tops in the camera image of a smartphone
Source: Asos, Screenshot iXtenso / Pott

How conveniently and reliably does this type of product search work with the four providers? Here are my results:

How well can the AI "see"?

Whether the pictures are taken vertically or horizontally is not important; the artificial intelligence recognizes the type of garment. With the H&M app, I only noticed that more skirts, pants, and dresses were suggested in the results when the picture was taken horizontally instead of just blouses or tops.

The apps can also handle incomplete shots quite well. The apps from H&M and Bonprix also suggested blouses when a partial shot of the blouse was taken, while the app from C&A picked up the pattern but suggested other garments besides tops (which doesn't have to be wrong).

A dark top in the camera image of a smartphone
Source: Bonprix, Screenshot iXtenso / Pott

I tested another challenge for the apps: What results do they provide when there isn't just one garment in the picture, (which can happen when shooting on a clothing rack or in a photo not taken specifically for the search).

If the two garments are hanging next to each other, the C&A app did not return any results.

The Bonprix app recognized both garments – even when they were partially hanging on top of each other – and gave me two individual result lists below each other that matched the two products well.

The ASOS app automatically focused on one of the two garments and only gave me results for the dark blouse.

A selection of garments in one app
Source: Bonprix, Screenshot iXtenso / Pott

Cropping option

When there are multiple garments in an image, but only one should be relevant to the search, features that allow you to set a focus on an overall image are very handy.

For this purpose, H&M and ASOS each offer the option to crop the image in their apps. This way, you can select one of several pictured garments or target only the fabric pattern or color for one item.

Filter and sort function

Finally, when I get a list of results, which at ASOS for example often included over 400 suggestions, sorting and filtering options are extremely useful for users, just like in webshops on websites. Here, too, the apps from H&M and ASOS stood out positively. Both offered features to sort or filter the results according to various criteria.

The filter function of a shopping app for clothes
Source: H&M, Screenshot iXtenso / Pott

User experience

Ultimately, it is not only the variety and quality of the results that is crucial for a comfortable shopping experience, but also how pleasant and intuitive the use of the app is for users.

The start in terms of visual search is good in all four apps: the search function is recognizable at first glance and the camera and photo search functions are simply designed and intuitive to use.

The apps from H&M and C&A also provide tips on what customers should look out for when taking pictures in order to achieve the best possible results.

The operation of functions such as the cropping option is also important. Here, I had a hard time with the H&M app: First, I didn't realize that I could change the cut at the corners of the grid, then I had a much harder time controlling the exact cutout than with the ASOS app.

For consumers, visual search functions offer a convenient search option in everyday life. Retailers should keep these options in mind for their own offerings.

Author: Julia Pott

related articles:

popular articles:

Thumbnail-Photo: Macy’s announces sustainable initiatives to drive a more circular...
30.09.2022   #sustainability #Tech in Retail

Macy’s announces sustainable initiatives to drive a more circular future

Through its social purpose platform, Mission Every One, Macy’s, Inc. is committed to creating a brighter future for all

Macy’s, Inc. has provided an update detailing its achievements towards its long-term sustainability goals – including initiatives that promote circularity throughout its value chain. ...

Thumbnail-Photo: E-commerce: For better, but also for worse!
12.12.2022   #e-commerce #sustainability

E-commerce: For better, but also for worse!

How to optimally reach the clientele in current times of crisis

Inflation, rising energy costs, Covid - these crises currently have Germany firmly in their grip and are consequently influencing consumer behaviour in the country in the long term. Due to rising living costs, German consumers are currently holding ...

Thumbnail-Photo: Innovative Specials at EuroShop 2023
20.01.2023   #brick and mortar retail #retail

Innovative Specials at EuroShop 2023

Interactive areas for ideas and visions in retail provide new approaches for the future of inner cities and retail as well as multi-sensorial places

The Specials of EuroShop, the World’s No. 1 Retail Trade Fair, will again provide exciting impulses for the future of retail this year. From 26 February to 2 March 2023 the eight Specials in total will invite visitors to join in, network and ...

Thumbnail-Photo: First retailers announced for Royalmount shopping centre...
11.11.2022   #brick and mortar retail #retail

First retailers announced for Royalmount shopping centre

Louis Vuitton, Gucci, Tiffany & Co. and RH with new presence in Montreal's new Midtown destination

Royalmount, Montreal's future destination for over 170 stores including 60 restaurants and experiential attractions, has announced that Louis Vuitton, Gucci, Tiffany & Co., RH, Sandro and Maje have been confirmed for the major new retail and ...

Thumbnail-Photo: How to win the Amazon algorithm
20.10.2022   #online trading #event

How to win the Amazon algorithm

Salsify webinar on 27th October 2022

Amazon’s data shows that 70 percent of Amazon customers never click past the first page of search results. But how can your brand’s products reach - and stay on - the first page of search results? Product content is a main component ...

Thumbnail-Photo: Passwordless add-on for Shopify Plus stores with Passkeys support...
21.12.2022   #security #digitization

Passwordless add-on for Shopify Plus stores with Passkeys support

Shopify Plus stores can now easily implement passwordless login with Passkeys support to help reduce drop rate and increase conversion using the free OwnID plugin

OwnID has announced the release of Passkeys support for all Shopify Plus stores. The new plugin is a low-code way to add passwordless authentication to your store. By eliminating the need to create and remember passwords, it allows users to register ...

Thumbnail-Photo: Launch of Walmart Land and Walmart’s Universe of Play...
14.10.2022   #omnichannel #food retail

Launch of Walmart Land and Walmart’s Universe of Play

Roblox community members can check out the Walmart ‘isles’ to collect verch, catch top music artists and unlock exclusive interactive content

Recently, Walmart announced the launch of two new immersive experiences in the metaverse mega-platform, Roblox. Called Walmart Land and Walmart’s Universe of Play, the spaces offer unique interactive content and entertainment for customers, ...

Thumbnail-Photo: E-Commerce Berlin Expo 2023
21.11.2022   #e-commerce #retail

E-Commerce Berlin Expo 2023

Be inspired by e-commerce trends, use cases, forecasts and presentations from leading industry experts

The E-Commerce Berlin Expo is the largest pure-play e-commerce event in the capital city of Germany. The conference attracts over 8,000 visitors and more than 200 exhibitors, making it an insightful e-commerce fest. ...

Thumbnail-Photo: Attracting young customers with sustainability and metaverse...
22.01.2023   #e-commerce #retail

Attracting young customers with sustainability and metaverse

How ByondXR wants to shape the future of e-commerce

In marketing, standstill leads to regression faster than in many other sectors. Strategies that were the cutting edge ten years ago often no longer work today. "Generation Z" in particular has its own very specific demands with regard to ...

Thumbnail-Photo: Kraft Heinz optimizes product content for 3000 SKUs to win on the...
07.12.2022   #e-commerce #digitization

Kraft Heinz optimizes product content for 3000 SKUs to win on the digital shelf

Salsify assists Kraft Heinz in delivering a consistent brand experience across every digital and physical retail channel

Salsify, the Commerce Experience Management (CommerceXM) platform empowering brand manufacturers, distributors, and retailers to win on the digital shelf, announced it is helping The Kraft Heinz Company update retailer product content in just ...

Supplier

salsify
salsify
7 rue de Madrid
75008 Paris