Report • 28.06.2022

Visual search – Finding products with images

Not only the result, but also the user experience is crucial

In online retail, a well-developed and easy-to-use product search is essential for customers. For a high level of convenience and optimal results, this now includes visual search. This means that users can search for similar items using images of clothing, for example.

I tested four apps from the following fashion providers for this function:

  • European clothing company C&A
  • German fashion mail order company Bonprix
  • Swedish clothing retailer H&M
  • British fashion mail order company ASOS

In all of these apps, users can upload pictures from the device's database to the search function or take pictures themselves with the camera to search for similar products.

Two tops in the camera image of a smartphone
Source: Asos, Screenshot iXtenso / Pott

How conveniently and reliably does this type of product search work with the four providers? Here are my results:

How well can the AI "see"?

Whether the pictures are taken vertically or horizontally is not important; the artificial intelligence recognizes the type of garment. With the H&M app, I only noticed that more skirts, pants, and dresses were suggested in the results when the picture was taken horizontally instead of just blouses or tops.

The apps can also handle incomplete shots quite well. The apps from H&M and Bonprix also suggested blouses when a partial shot of the blouse was taken, while the app from C&A picked up the pattern but suggested other garments besides tops (which doesn't have to be wrong).

A dark top in the camera image of a smartphone
Source: Bonprix, Screenshot iXtenso / Pott

I tested another challenge for the apps: What results do they provide when there isn't just one garment in the picture, (which can happen when shooting on a clothing rack or in a photo not taken specifically for the search).

If the two garments are hanging next to each other, the C&A app did not return any results.

The Bonprix app recognized both garments – even when they were partially hanging on top of each other – and gave me two individual result lists below each other that matched the two products well.

The ASOS app automatically focused on one of the two garments and only gave me results for the dark blouse.

A selection of garments in one app
Source: Bonprix, Screenshot iXtenso / Pott

Cropping option

When there are multiple garments in an image, but only one should be relevant to the search, features that allow you to set a focus on an overall image are very handy.

For this purpose, H&M and ASOS each offer the option to crop the image in their apps. This way, you can select one of several pictured garments or target only the fabric pattern or color for one item.

Filter and sort function

Finally, when I get a list of results, which at ASOS for example often included over 400 suggestions, sorting and filtering options are extremely useful for users, just like in webshops on websites. Here, too, the apps from H&M and ASOS stood out positively. Both offered features to sort or filter the results according to various criteria.

The filter function of a shopping app for clothes
Source: H&M, Screenshot iXtenso / Pott

User experience

Ultimately, it is not only the variety and quality of the results that is crucial for a comfortable shopping experience, but also how pleasant and intuitive the use of the app is for users.

The start in terms of visual search is good in all four apps: the search function is recognizable at first glance and the camera and photo search functions are simply designed and intuitive to use.

The apps from H&M and C&A also provide tips on what customers should look out for when taking pictures in order to achieve the best possible results.

The operation of functions such as the cropping option is also important. Here, I had a hard time with the H&M app: First, I didn't realize that I could change the cut at the corners of the grid, then I had a much harder time controlling the exact cutout than with the ASOS app.

For consumers, visual search functions offer a convenient search option in everyday life. Retailers should keep these options in mind for their own offerings.

Author: Julia Pott

related articles:

popular articles:

Thumbnail-Photo: E-commerce Berlin Expo 2022 Recap
10.05.2022   #e-commerce #sustainability

E-commerce Berlin Expo 2022 Recap

Last week, the E-commerce Expo 2022 took place in Berlin. Find out what happened there

The E-commerce Berlin Expo 2022 conference is over, and it's safe to say that it was a huge success! If you attended, you probably learned a lot of new things about the e-commerce industry.But if you didn't go, don't worry - here’s ...

Thumbnail-Photo: Playfully - simple? Gamification in retail
20.04.2022   #Tech in Retail #smartphone

Playfully - simple? Gamification in retail

How retailers can win new customers with gamification

Whether at the bus stop, in the waiting room, out and about in the city or relaxing on the sofa - the smartphone has become a constant companion for most people over the last ten years. Anyone who has a moment to spare takes a look at the countless ...

Thumbnail-Photo: Ynvisible supports sustainable fashion with digital price labels...
13.05.2022   #digitization #sustainability

Ynvisible supports sustainable fashion with digital price labels

New generation is easily readable, flexible and customizable

Ynvisible Interactive Inc. has announced that Digety, a company creating electronic price labels for the fashion industry, has selected Ynvisible as the supplier of displays for its re-usable digital price labels. Digety’s price labels ...

Thumbnail-Photo: 4 tips for improving retail customer experience...
12.04.2022   #customer satisfaction #Tech in Retail

4 tips for improving retail customer experience

Customer experience can make or break a retail business, so it's vital to get it right

In the retail industry, customer experience is one of the most critical elements for success. It serves as the foundation for customer loyalty, repeat business, and word-of-mouth referrals. In other words, an excellent customer experience is what ...

Thumbnail-Photo: Weekly grocery shopping made easy: meal planning via app...
18.05.2022   #online trading #e-commerce

Weekly grocery shopping made easy: meal planning via app

Grocery shopping, ordering, recipes – all in one app with connection to local grocery stores

Grocery shopping can be fun. For a five-person household with a baby and a dog, including allergies and favorite dishes, it quickly becomes a mammoth task. The developers of the app Jow want to simplify this very process and are teaming up with ...

Thumbnail-Photo: Cross-border e-commerce to exceed $2 trillion for first time in 2023...
14.04.2022   #e-commerce #payment systems

Cross-border e-commerce to exceed $2 trillion for first time in 2023

Juniper Research: Cross-border e-commerce to account for 38% of all e-commerce transactions globally by value in 2023

A new study from Juniper Research has found that the value of cross-border e-commerce will exceed $2.1 trillion in 2023, from $1.9 trillion in 2022. This growth of over 13% in a single year reflects the increasing success of marketplaces which offer ...

Thumbnail-Photo: 70 % of US consumers continue to shop online for groceries amid the...
25.02.2022   #online trading #coronavirus

70 % of US consumers continue to shop online for groceries amid the pandemic

Pandemic-related shopping habits remain firmly in place

Acosta has released its latest research report, The Lingering Impact of COVID-19 on U.S. Shoppers. The report examines U.S. shoppers’ behavior nearly two years into the pandemic. According to Acosta’s research, most of today’s ...

Thumbnail-Photo: Carvana launches newest car vending machine
09.05.2022   #e-commerce #Tech in Retail

Carvana launches newest car vending machine

Online retailer opens 32nd car vending machine in the U.S.

Carvana has launched its newest car vending machine, located in San Francisco, California. The state-of-the-art steel and glass structure debuts in the tech capital of America, standing eight stories tall with a 27-vehicle capacity, offering car ...

Thumbnail-Photo: American and European retail brands bounce back better as values...
02.05.2022   #retail #coronavirus

American and European retail brands bounce back better as values increase post-COVID

Big retailers like Amazon and Walmart apply their logistics expertise to adapt in innovative ways to the ‘new normal’

American and European retail brands are leading the global retail sector in bouncing back better from the pandemic, with Amazon and Walmart leading the way. In a world of changing customer demand and disrupted supply chains, these big retailers are ...

Thumbnail-Photo: Renting instead of buying: A sustainable consumption system on the rise?...
04.04.2022   #sustainability #fashion

Renting instead of buying: A sustainable consumption system on the rise?

Highlights from a webtalk about subscription services and circular economy at Decathlon

Companies often find themselves in a balancing act: they have to prioritize between long-term and short-term goals. How much do we invest in sustainable business models and environmental and climate protection? Many entrepreneurs are faced with ...

Supplier

salsify
salsify
7 rue de Madrid
75008 Paris
Canto GmbH
Canto GmbH
Lietzenburger Str. 46
10789 Berlin