Setup A/B Testing in Sitecore - Part 3 - Final Results

 

Setup A/B Testing in Sitecore - Part 3 - Final Results

In my previous article, we have setup a Page Test on Home Item which is currently in active state. In this article we will see the effect after setting up the Test Case and then picking up a winner and then see the result output. 

As you know, our A/B Test is active on a home page item so if you open the home page on 2 different browser, then you should see 2 different version of home page, like below:

 

 

This effect is due to the running test of the same item. Based on the configuration you have chosen while setting up a Test like number of version selected, percentage of visitor exposed etc.

 On the other hand, in the CMS you should notification bar when you select the page item on which you have setup Test. In our case its on home page.


Behind the scenes, Sitecore captures the Analytics data and shows the stats which help you choosing your winner. If you remember, while setting up the test case I have selected the option Manually select winner in Test Objective:


Coming back to showing you the stats, when you select either of the version you can some important stats coming on right side of the panel.


  

Based on the requirements you can act and go ahead with choosing your winner.


 

What happens after selecting a Winner? 

I was very curious to know what happens after selecting one of the version as a winner. The outcome was, A new version of the home page item was created with data source which was assigned to winner version of that item. The point to note is this version was auto deployed on web database. That means we don’t have to manually choose any data source item nor we have to deploy anything. 

Hope this series of A/B Testing helped you at any point. See you soon.

Comments

Post a Comment

Popular posts from this blog

Working with Device Detection Module in Sitecore

Image
  What is Device Detection in Sitecore? Sitecore has an in-built feature called Device Detection which helps to detect at which device the content is shown into. When I say in-built that means its included as a standard feature in Sitecore XP 9.0 and later. This feature is also present in Sitecore XM Cloud , hence you do not need to buy a separate add-on or module to utilize device detection features.   The information gather from Device Detection Module can help content makers, allowing them to tailor the website experience based on the device type they are accessing it with, such as by displaying different layouts or content depending on screen size and capabilities. For Example, An iPhone and Android users might be looking at different content on same page.   Moreover, developers uses the same mechanism to personalize the components based on the device specific audience. They can setup Device Layout based on specific device parameters or can use the in-built rules...
Read more

Setup A/B Testing in Sitecore - Part 1

Image
  Setup A/B Testing in Sitecore - Part 1 In this article we will understand What is A/B Testing, Types of Testing in Sitecore, Actual Use Case and later we will see how we can setup A/B Testing in Sitecore XP solution with Rendering having different data source items.   Before we go further, lets understand WHAT IS A/B Testing ? A/B testing, also known as split testing, is a method used in marketing and product development to compare two versions of something to determine which one performs better. In an A/B test, two versions, A and B, are created, with one varying element between them. This element could be anything from the wording of an email subject line, the design of a web page, the placement of a button, or even the pricing of a product.   The versions, A and B, are then randomly  shown to similar audiences or users, and their responses are measured and compared. The version that performs better in terms of predefined metrics (such as click-through rate, conv...
Read more

Working with Webhooks in Sitecore - Part 1

Image
  Working with Webhooks in Sitecore - Part 1 In this blog we will understand the concept of Webhooks and how we can use them in Sitecore. So before jumping into Webhooks in Sitecore, first lets understand what webhooks are?   What is a Webhook? They are typically created to connect/link different applications. They are much like API but different from them. Webhooks are one way that apps can send automated messages or information to other apps.   Consider an example below:     Suppose, there is a user facing front application which showcase the product catalogs to its customers. This application is responsible for booking an order from its users. BUT the logistics is handle by different application.   The second application (logistic app) has setup a webhook which is exposed over http and waiting to receive any confirmed orders. Once someone place any order which can be called as an event for the first application, then along with its operation it is passin...
Read more