What is A/B Testing?
As the name implies, two versions (A and B) are compared(though more than 2 tests can be conducted), which are identical except for one variation that might affect a user’s behavior. This means you will maintain the same style(bar, slider, modal or takeover), same Goal and the same Targeting Rules, and that is only if you are using that feature.
You may change the Content of the Hello Bar, the Color options and the Timing on when it can appear.
How Does A/B Testing Work With Hello Bar?
When Creating a A/B test, Hello Bar functions automatically by testing the site elements. The “automatic” function is a two-part system.
Part 1: Automatically triggering the A/B tests
This happens when you have two bars of the same type (2 sliders or 2 modals, etc.), which are then targeted to be displayed on the same page of the associated website. The A/B tests will not show at the same time, but rather a single version within the A/B test will show to any new IP address that visits your site.
Part 2: Automatically interpreting A/B test results
At first, we make sure that all site elements which are a part of the A/B test receive at least 1000 views. When this happens, we check which site
element converts the best and from this point on, for 90% of views we will display this element. In 10% of the views, we will display a random element, regardless of how good the best element converts. This is so that when user edits his bars, especially those not converting properly, we will give them some chance. And if the previously worse converting bar now starts converting
better, at some point we will automatically switch to it. In the example above we can see that the 2nd bar converts slightly better (even though the number is rounded to 0.4%), so it is being displayed more often. First bar doesn’t stop at 1000 views and is still being displayed in 5% of views (10% of views gets a random element out of those two).
How to A/B Test a Hello Bar
To A/B test a Hello Bar, first create a Hello Bar by clicking the ‘Create New’ button on the left hand side of your Dashboard. This first Hello Bar you create will be ‘Version A’, once you have saved that, click the Manage tab on the left hand side of your Dashboard where you will find the Hello Bar you just created.
Next, click the Gear Icon on the left side of ‘Version A’ and select Variation for the drop down menu. This will bring you into the Edit screen where you can make various changes, such as the Content of the Hello Bar, the Color options and the Timing on when it can appear.
Once you have finished making the changes, you can then proceed to Save & Exit to finalize ‘Version B’.