A/B testing is an effective method for improving web pages, increasing conversion rates, and delivering seamless and engaging user experience. It allows you to experiment with different versions of your website elements—be it headlines, layouts, call-to-action buttons, or images—to see which version resonates better with your audience.

Variations are presented to users, and subsequent statistical analysis is used to determine which version is more successful in reaching a specific conversion target.

With NotifyVisitors, setting up A/B test campaigns is a breeze thanks to our user-friendly interface. You can create website variations using a simple drag-and-drop tool, eliminating the need for any coding skills. Plus, our analytical dashboard lets you track the performance of each variation, empowering you to make data-driven decisions that enhance user engagement and drive conversions.

Let’s dive into the campaign creation process:

Step-by-step process:

To begin with, you can navigate to the "On-Site" tab in the dashboard and click on the "Website A/B Test" tab under the CRO section.

On this page, you'll find a list of the campaigns you've created, along with several other options. We'll explore this in more detail later in the article. For now, let's focus on how to create a new campaign. Simply click the “Create new A/B Test” button, and a new window will pop up showing you the five stages involved in setting up an A/B test campaign, as outlined below.

1. Settings

› Name and Page URL: On the Settings page, first assign a recognizable “campaign name” for easy tracking, and then enter the webpage where the A/B test will be conducted.

› Single/multi-page test: Next, you have to select the single or multi-page option. By default, single page is selected, which means changes you make in the provided URL will only be reflected on that page, whereas in multi-page, the changes you make on this page will reflect on other provided pages as well.

For example, you’ve provided the main URL as https://www.ecommercestore.com/home, and your purpose is to change the background of the website header. The header change should also reflect on other pages, such as https://www.ecommercestore.com/aboutus

To do this, you can select the multi-page option and add the origin path, URL path, or Page URL with multiple condition options to choose from.

For our example case, we can either add the origin path https://www.ecommercestore.com in case we want to apply changes to all pages that follow or can add specific URL paths for about us and explore page (‘/aboutus’ and ‘/explore’).

You can click the “+” icon to add multiple URLs, conditions, and values per your requirements or click the delete button to remove one.

Next, we also need to decide on a group condition. If we choose 'All of these', any modifications made on the variation page will be applied to other pages that meet all the specified conditions. Conversely, if we opt for 'Any of these', the changes will take effect on pages that meet at least one of the defined conditions.

For instance, in the above image, we selected 'Any of these', which means the changes will be applied to the about us page even if the '/explore' condition isn't satisfied. However, if we had chosen 'All of these', the changes wouldn't apply to the about us page since the '/explore' condition is not met.

› Run time: In this section, you have to define the start and end dates of the experiment.

› Heatmaps: Lastly, you can enable heatmaps to gain insights into user interactions on different variations. 

Once all options on the settings page are defined, click the “Continue to Variation” button to proceed to the next step.

2. Variation

On this page you can create multiple variations of the page you’ve added in the settings. Variations are different versions of your webpage that will be tested against each other. You can create variations of the main page by clicking on the “Create New Variation” button.

Next, we have a table showing a unique ID for each page, name (control denotes original page), changes (number of changes you made to each variation), and the action button which allows you to edit, delete, preview, or rename the variation.

After creating your variations, you can make changes to each variation by selecting the edit option from the three-dotted action button. With this, you’ll enter our website editor where you can modify the page elements (such as headlines, buttons, or images) without any coding skills. 

Variation traffic division percentage

At the bottom of this page you have the option to assign traffic percentages to control how users are split between variations. By default, our system splits the traffic in equal percentages.

After defining the variations, proceed by selecting "Continue to Targeting Rules."

3. Targeting rules

Targeting rules allow you to define the conditions under which your A/B test will run, ensuring it reaches the right audience. NotifyVisitors allows you to target users based on technographics (device type, browser, OS, etc.), time of day, traffic sources, audience, location, and more. 

Click here to explore each option in detail.

After defining the targeting parameters, click "Continue to Goals" to proceed.

4. Goals

Goals establish the criteria for measuring the success of your A/B test. You can monitor interactions like clicks on elements, links, or page visits by selecting the appropriate option from the first dropdown menu. Then, pick conditions from the second dropdown, such as contains, equals, starts with, and so on, and finally, input the value in the last field. 

Check out the image below for an example.

To add multiple goals, you can click the ‘+ Add More’ button. Once all done, click on the ‘Update’ button to save the process.

Lastly, click “Continue to Review” button to move to the next stage.

5. Review

In the Review stage, you'll find a comprehensive summary of all your campaign settings from the previous four stages displayed on one page. This step allows you to go over every detail before you officially launch the campaign.

Once you have verified everything, click the Finish button, and your A/B test campaign will be added to the campaign list.

Campaign list interface

The campaign list interface provides an overview of all your created A/B test campaigns. Each campaign is displayed with a unique campaign ID, name, control page URL, status, number of variations, number of goals, creation date & last modification date, and action button for quick management.

To activate or deactivate a campaign, simply toggle the status switch.

Action menu

Clicking the three-dot action button of a campaign opens a menu with the following options:

• Analytics – View detailed insights into your A/B test experiment.
• Edit – Modify your campaign settings.
• Variations – Edit, create, or remove variation pages directly.
• Goals – Edit, create, or remove goals directly.
• Clone – Duplicate the campaign.
• Delete – Permanently remove the campaign.

Conclusion

A/B testing is a powerful strategy for optimizing your website and improving user engagement. With NotifyVisitors, you can seamlessly create, manage, and analyze A/B test campaigns. Our intuitive interface, advanced targeting options, and detailed analytics ensure that you make data-driven decisions to enhance conversions. 

Start experimenting today and unlock the full potential of your website!