Use case: A/B testing collection merchandising

A/B testing on the Tagalys dashboard allows merchants to simultaneously test multiple variants of the same collection with different merchandising strategies. Here are some use cases of A/B testing:

Use case: Pinning different products based on different metrics in each variant of the A/B test

The pinning feature allows merchants to manually drag and drop products at any position. This is done within the 'Curate' panel. Click here to understand the functionality of pinning products.

Objective of the test: To determine which set of pinned products performs better based on chosen metrics like units sold or newly published products.

How it works:

• Create an A/B test with 2 variants:
  • Variant A: The primary variant of the collection is merchandised by pinning the products with higher revenue on the first page.
    
  • Variant B: The secondary variant is merchandised by pinning the products that have a higher number of views on the first page
    

Use case: Compare the performance of products within a collection by pinning different products.

How it works:

• Create an A/B test with 2 variants:
  • Variant A: The primary variant of the collection is merchandised by manually pinning a specific set of products to desired positions.
  • Variant B: The secondary variant is merchandised by manually pinning a different set of products to the same or different desired positions.
    Objective of the test: To determine which specific set of manually pinned products performs better based on chosen metrics like units sold or conversion rate.
  • Steps to pin products in each variant:

The pinning feature allows merchants to manually rearrange products at any position. This is done within the 'Curate' panel.

To pin a single product (Drag and Drop):

1. Navigate to the merchandising page and select the 'Curate' icon to enable static positioning. [Screenshot Placeholder: Curate icon selected]
2. Hover over the center of a product tile, click the 'Reorder' icon, and drag the item to your desired target position. [Screenshot Placeholder: Product being dragged]

To pin multiple products at once:

1. Click the 'Curate' icon and select relevant products. [Screenshot Placeholder: Multiple products selected]
2. Click the 'Pin' icon.
3. Enter the target position number, and confirm the action by clicking 'Pin at Position.' [Screenshot Placeholder: Pin at Position modal]

Use case: Compare the performance of a collection with Smart Sequencing enabled vs. disabled

Click here to understand the functionality of smart sequencing

How it works:

• Create an A/B test with 2 variants:
  • Variant A: The current version of the collection page can be merchandised using sequences of products. The sequences will remain static until manually reordered.
    

• • Variant B: The secondary variant of the collection page, will also be merchandised using product sequences but with the 'smart sequence' feature enabled. This will enable the product sequences to be automatically re-ordered once a day based on the chosen performance metric. In the below example, units sold over the last 30 days is the metric based on which sequences will be reordered.
    

• Objective of the test: To determine whether activating smart sequencing (which automates the sorting of product sequences) enhances the overall effectiveness of the collection page.

Use case: Tagalys 'Trending' vs. Manual Product Pinning 

• How it works:
  • Create an A/B test with 2 variants.
    • Variant A: The primary variant of the collection can be merchandised by manually pinning products in the desired positions.
      
    • Variant B: The secondary variant can be merchandised dynamically using the Tagalys 'trending' sorting option where products are being reordered based on the trending score of the product.
      
• Objective of the test: To analyze if pinning products to static positions in a collection results in better performance compared to automating the product sorting based on the trending score. 
• To take it a step further, users can also create a third variant which can be a combination of both merchandising strategies. For instance, pinning the first 8 products and then using 'Trending' to sort the remaining products to analyze if that would be the best approach. 
  

Use case: Product Sequences vs 'Field' 

• How it works:
  • Create an A/B test with 2 variants:
    • Variant A: The primary variant can be merchandised using product sequences to create a visually pleasing sorting order
      
    • Variant B: The secondary variant can be set up using the 'Field' merchandising option to unidirectionally sort the entire collection page using a single performance metric. (For example, conversion %)
      
• Objective of the test: To understand which strategy yields better results, whether displaying products in a visual story by adding structure and showing variety or arranging them based on a performance metric.