Report • 28.06.2022

Visual search – Finding products with images

Not only the result, but also the user experience is crucial

In online retail, a well-developed and easy-to-use product search is essential for customers. For a high level of convenience and optimal results, this now includes visual search. This means that users can search for similar items using images of clothing, for example.

I tested four apps from the following fashion providers for this function:

  • European clothing company C&A
  • German fashion mail order company Bonprix
  • Swedish clothing retailer H&M
  • British fashion mail order company ASOS

In all of these apps, users can upload pictures from the device's database to the search function or take pictures themselves with the camera to search for similar products.

Two tops in the camera image of a smartphone
Source: Asos, Screenshot iXtenso / Pott

How conveniently and reliably does this type of product search work with the four providers? Here are my results:

How well can the AI "see"?

Whether the pictures are taken vertically or horizontally is not important; the artificial intelligence recognizes the type of garment. With the H&M app, I only noticed that more skirts, pants, and dresses were suggested in the results when the picture was taken horizontally instead of just blouses or tops.

The apps can also handle incomplete shots quite well. The apps from H&M and Bonprix also suggested blouses when a partial shot of the blouse was taken, while the app from C&A picked up the pattern but suggested other garments besides tops (which doesn't have to be wrong).

A dark top in the camera image of a smartphone
Source: Bonprix, Screenshot iXtenso / Pott

I tested another challenge for the apps: What results do they provide when there isn't just one garment in the picture, (which can happen when shooting on a clothing rack or in a photo not taken specifically for the search).

If the two garments are hanging next to each other, the C&A app did not return any results.

The Bonprix app recognized both garments – even when they were partially hanging on top of each other – and gave me two individual result lists below each other that matched the two products well.

The ASOS app automatically focused on one of the two garments and only gave me results for the dark blouse.

A selection of garments in one app
Source: Bonprix, Screenshot iXtenso / Pott

Cropping option

When there are multiple garments in an image, but only one should be relevant to the search, features that allow you to set a focus on an overall image are very handy.

For this purpose, H&M and ASOS each offer the option to crop the image in their apps. This way, you can select one of several pictured garments or target only the fabric pattern or color for one item.

Filter and sort function

Finally, when I get a list of results, which at ASOS for example often included over 400 suggestions, sorting and filtering options are extremely useful for users, just like in webshops on websites. Here, too, the apps from H&M and ASOS stood out positively. Both offered features to sort or filter the results according to various criteria.

The filter function of a shopping app for clothes
Source: H&M, Screenshot iXtenso / Pott

User experience

Ultimately, it is not only the variety and quality of the results that is crucial for a comfortable shopping experience, but also how pleasant and intuitive the use of the app is for users.

The start in terms of visual search is good in all four apps: the search function is recognizable at first glance and the camera and photo search functions are simply designed and intuitive to use.

The apps from H&M and C&A also provide tips on what customers should look out for when taking pictures in order to achieve the best possible results.

The operation of functions such as the cropping option is also important. Here, I had a hard time with the H&M app: First, I didn't realize that I could change the cut at the corners of the grid, then I had a much harder time controlling the exact cutout than with the ASOS app.

For consumers, visual search functions offer a convenient search option in everyday life. Retailers should keep these options in mind for their own offerings.

Author: Julia Pott

related articles:

popular articles:

Thumbnail-Photo: K5 Future Retail Conference - Top speakers on all aspects of e-commerce...
25.05.2023   #e-commerce #retail

K5 Future Retail Conference - Top speakers on all aspects of e-commerce

20.06.2023 - 21.06.2023 | Berlin

On June 20 and 21, 2023, the ESTREL Berlin will open its doors. Top speakers and experts from e-commerce will come together at the K5 FUTURE RETAIL CONFERENCE 2023. This year, K5 is taking place under very special conditions: the ongoing ...

Thumbnail-Photo: Grove Co. announces new retail partnerships with Kroger, Costco and...
08.06.2023   #retail #sustainability

Grove Co. announces new retail partnerships with Kroger, Costco and Hannaford

Leading sustainable consumer products company increases in-store presence at 450 additional brick & mortar locations

Grove Collaborative Holdings, Inc. (NYSE: GROV) (“Grove” or “the Company”), a leading sustainable consumer products company and Certified B Corp, today announced another significant retail expansion for Grove Co., its ...

Thumbnail-Photo: New GS1 Germany requirements in force for better data quality...
12.06.2023   #online trading #digitization

New GS1 Germany requirements in force for better data quality

Brands facing new challenges to providing product content to German retailers through the GDSN

GS1 Germany released two new requirements impacting brands selling food/beverage (and food-adjacent) products to the German market aiming at increasing product data quality passing through the Global Data Synchronization Network (GDSN). ...

Thumbnail-Photo: K5 Future Retail Conference
03.05.2023   #e-commerce #retail

K5 Future Retail Conference

20.06.2023 - 21.06.2023 | Berlin, Germany

#LEARNFROMTHEBEST #MEETTHEBEST #BETHEBESTOn June 20 and 21, 2023, the K5 Future Retail Conference 2023, the absolute highlight of the e-commerce year, will take place for the 11th time. A fascinating event awaits you in 2023 as well: numerous ...

Thumbnail-Photo: University of Bayreuth: Supermarket of the Future...
12.05.2023   #brick and mortar retail #sustainability

University of Bayreuth: Supermarket of the Future

A board game for creative engagement with novel foods

The labeling of novel foods with the aim of promoting sustainable consumption decisions is currently a much-discussed topic in science, industry and politics. The Simon Nüssel Foundation has recently started funding an unusual research project ...

Thumbnail-Photo: In-store communication: the key is feeling good...
30.03.2023   #multichannel commerce #customer experience

In-store communication: the key is feeling good

What matters in the meantime is the optimal customer approach

"Bringing Digital Retail to Life". For Radio Point of Sale GmbH of Kiel, Germany, the slogan says it all. The company focuses on the possibilities of auditory, visual and interactive communication at the point of sale within the ...

Thumbnail-Photo: Shoptalk Europe
02.05.2023   #e-commerce #retail

Shoptalk Europe

09.05.2023 - 11.05.2023 | Barcelona, Spain

Uniting Europe's entire retail ecosystemThe biggest, most influential and rising retailers and brands across Europe and worldwide unite at Shoptalk Europe for unrivaled business-critical connections, conversations, insights and extraordinary ...

Thumbnail-Photo: Automation: Is this the future of shopping?
06.06.2023   #brick and mortar retail #food retail

Automation: Is this the future of shopping?

On the shortcomings and advantages of autonomous store concepts

Grocery shopping and self-service – the Blockstore Group combines the necessary with the pleasant and helps retailers implement autonomous and automated store concepts. In particular, the Finnish start-up helps to install a suitable ...

Thumbnail-Photo: Extenda Retail launches loss prevention engine...
26.05.2023   #brick and mortar retail #retail

Extenda Retail launches loss prevention engine

Industry leader in retail software development, launches a revolutionary self service and loss prevention (SSLP) solution, powered by machine learning to tackle self-service retail challenges

Retailers are increasingly offering self-serve options to in-store consumers ranging from self-checkout to self-scan, and mobile Scan & Go. And with the boom of self-service comes the inevitable increase in shrink which Forbes now estimates to ...

Thumbnail-Photo: The future of marketing is conversational
13.04.2023   #customer satisfaction #digitization

The future of marketing is conversational

Global survey: 88% of consumers are seeking text messaging conversations with brands

Consumers around the world are more comfortable than ever interacting with brands, when they feel they’re getting value. The annual "State of Conversational Commerce Report" from Attentive revealed 91% of consumers have already opted ...


Extenda Retail Ab
Extenda Retail Ab
Gustav III:s Boulevard 50A
169 73 Solna