Setup A/B Testing in Sitecore - Part 2

 

Setup A/B Testing in Sitecore - Part 2

In my previous article, we discussed about the types of Tests in Sitecore and their scope. In this blog we will setup a Page test on home page item and will make it active. 

To show the Page test, I have created a simple view rendering named Article which takes a data source item created from a template that has some simple data text field. 

We will create 2 versions for home page item and will apply Article view rendering having different data source item on different version of home page item. The idea is we are going to create 2 versions of same page having different content in it.


 

We will expose full traffic to home page and Sitecore will manage to show either of the version to a visitor. 

Step 1: Creating Template, Rendering and Data source, below is the sample which I created: 

Template: 


Rendering: 


 2 Data Sources:


Step 2: Set Article View Rendering on Home Page Version 1 with Gold Article as data source

 

Step 3: Create New Version and Set Article View Rendering with Bronze Article as data source.


 

Note: Now at point you have 2 version i.e 3 and 4 on which same component is applied BUT with different data sources. 

Now lets setup a Test on Home Page Item: 

Step 1: Go to Experience Optimization from launchpad

 


 Step 2: Create Test


Step 3: Choose the Control i.e the variant on which you want to setup A/B test on.

Step 4: At this screen, you need to select the Page to test against, so click on the + icon

 


Step 5: In our case we will be selecting previous version of same page.

You can choose from whatever option which suits you depending upon the target item.

Step 6: Setup Test [Important]

You can see all versions selected for test


Predict how the test will effect the visitor engagement. Your prediction is used in your performance report, which you can use to improve your optimization skills.


The percentage of users you wanted to expose to this test, Example if set to 50% then half of the visitor will get redirect to different versions of home page, rest remaining will see the Control variant. In our case we are setting up to 100%.


According to me, this value is needed at which Test has to reach up before any winner is selected. More the percentage, longer should be the test. In our case, we will be choosing an winner manually to keeping it at 95%

Choose the Test objective here, in my case I usually select Trailing Value/Visit and Manually select winner. It means we are calculating the number of user visits on each version and we can select the winner based on the Test Objective which we have set.


 Choose the duration and Start the test. You should see the success message on top the page:

 



In case you can’t see any test running, check you Solr Settings, in my case I need to rebuild the test index:

So lets see the results in my next blog. See you then.

Comments

Post a Comment

Popular posts from this blog

Working with Device Detection Module in Sitecore

Image
  What is Device Detection in Sitecore? Sitecore has an in-built feature called Device Detection which helps to detect at which device the content is shown into. When I say in-built that means its included as a standard feature in Sitecore XP 9.0 and later. This feature is also present in Sitecore XM Cloud , hence you do not need to buy a separate add-on or module to utilize device detection features.   The information gather from Device Detection Module can help content makers, allowing them to tailor the website experience based on the device type they are accessing it with, such as by displaying different layouts or content depending on screen size and capabilities. For Example, An iPhone and Android users might be looking at different content on same page.   Moreover, developers uses the same mechanism to personalize the components based on the device specific audience. They can setup Device Layout based on specific device parameters or can use the in-built rules...
Read more

Setup A/B Testing in Sitecore - Part 1

Image
  Setup A/B Testing in Sitecore - Part 1 In this article we will understand What is A/B Testing, Types of Testing in Sitecore, Actual Use Case and later we will see how we can setup A/B Testing in Sitecore XP solution with Rendering having different data source items.   Before we go further, lets understand WHAT IS A/B Testing ? A/B testing, also known as split testing, is a method used in marketing and product development to compare two versions of something to determine which one performs better. In an A/B test, two versions, A and B, are created, with one varying element between them. This element could be anything from the wording of an email subject line, the design of a web page, the placement of a button, or even the pricing of a product.   The versions, A and B, are then randomly  shown to similar audiences or users, and their responses are measured and compared. The version that performs better in terms of predefined metrics (such as click-through rate, conv...
Read more

Working with Webhooks in Sitecore - Part 1

Image
  Working with Webhooks in Sitecore - Part 1 In this blog we will understand the concept of Webhooks and how we can use them in Sitecore. So before jumping into Webhooks in Sitecore, first lets understand what webhooks are?   What is a Webhook? They are typically created to connect/link different applications. They are much like API but different from them. Webhooks are one way that apps can send automated messages or information to other apps.   Consider an example below:     Suppose, there is a user facing front application which showcase the product catalogs to its customers. This application is responsible for booking an order from its users. BUT the logistics is handle by different application.   The second application (logistic app) has setup a webhook which is exposed over http and waiting to receive any confirmed orders. Once someone place any order which can be called as an event for the first application, then along with its operation it is passin...
Read more