A split test in VWO is typically created to test multiple versions of your website hosted on different URLs. If your Variation is on a different address or has major design changes compared to Control, we’d recommend you to create a Split URL Test. To know more, refer to Split URL testing in VWO.
Creating a Split URL test campaign in VWO typically involves the following steps:
- Setting up pages for your test
This is the first and foremost step in creating your Split URL test in VWO. Here, you specify the hypothesis, define the URLs for control, variation, preview pages, and configure the visitor segments for your Split URL test. To know more about setting up pages for your test, refer to Setting-up Pages for Your Test in VWO. - Adding conversion goals
Once your variations are ready, you can define the events you want to record a goal conversion in VWO. When a visitor performs the event you defined, VWO will record a goal conversion. For example, you can record goal conversion when users click on a link, visit pages, submit forms, and so on. To know more about adding conversion goals, refer to Adding Conversion Goals in VWO. - Finalizing your test
The last step in creating your Split URL test is to configure some advanced options allocating traffic percentage to the variations, integrating VWO data with third-party products such as Google Analytics, etc. To know more about finalizing your test configurations, refer to Finalizing Your Test in VWO.
Steps to Create a Split URL Test in VWO
Prerequisite
You need to add the VWO SmartCode to the web pages you want to test. To learn how to add VWO Smartcode to your website, refer to Configuring Smartcode for your Website.
On the main menu of your VWO dashboard, go to Testing > Split URL > Create. The campaign is created, and it opens the Configuration tab, where you can define the details of your campaign as follows.
Create Variations
In the Variations section, you get to do the following:
- Declare the page URL for individual versions (control and variations) that you have already made.
You can also configure the traffic split among the variations and control. By default, it is split equally. - To add another variation to the existing one, you can click on the Add variation option and name it. Click on the Edit button to edit the new variation.
Every variation comes with Preview, Clone, and Delete options. - Click Save Now.
Define Your Goals / Metrics
On the Goals / Metrics (for accounts enabled with Data360) page, you get to define the key performance indicators to be tracked for determining the campaign results. For example, an action such as arriving at the home page and clicking on the subscribe button in the signup form that appears. In short, it requires you to specify what action on which page to measure the conversions.
To set up goals for your test campaign, perform the following steps:
- By default, your goal is named as Goal 1. You can rename it by clicking on the edit icon present next to the goal name.
- From the Goal Type dropdown, select the goal type you want to work with. To know more about different goal types in VWO, refer to Different Types of Conversion Goals in VWO.
- In the Include URLs field, specify the operation from the dropdown, and in the field next to it, enter the URL of the webpage where you want to track the conversions. If you wish to exclude a webpage from the goal conversion tracking, use the Exclude URL option to specify the operation and the URL of that page.
- To track another activity in your campaign, click Add Another Goal.
NOTE: If you add multiple goals, you can specify one goal as Primary Goal. VWO declares a variation as a smart decision or a winner based on the primary goal. If you have multiple goals in your test, then the goal directly and exclusively impacted by the changes you make in the test must be chosen as the primary goal. By default, the first goal is considered a Primary Goal. - Additionally, at the bottom of the page, the Frequently used goals section is present, which shows the goals you use the most. You can either search or choose from the ones displayed. Selecting a goal from here allows you to reuse the goal code instead of configuring a new one.
NOTE: The frequently used goals appear based on the domain specified for the campaign URL.
If your VWO account is enabled with Data360, you will be able to use Metrics instead of Goals. Metrics are more flexible and highly configurable. On the Metrics page, you can declare multiple metrics, out of which one needs to be primary, and the rest can be kept as secondary. The primary metric is the one based on which a variation is declared as a winner or a smart decision. It is also the one that is directly and exclusively impacted by the changes you make in the test campaign. To set up these metrics for your test campaign, perform the following steps:
- Under the Primary metric section, click Add primary metric.
- You can either select one of the metrics you have already created in the Data360 module or create one by clicking Create a new metric.
- In the Create Metric popup that appears, enter the name of the metric and select the event in the dropdown. You can choose either a system-defined event from Standard Events or a custom event from My Events.
- Now click on +where to specify the URL of the page/element on which you want to track the event. Specify the URL matching condition and specify the URL of the web page. You can include or exclude pages as required. You can add more locations by clicking +and where and creating a criterion for locating the pages/elements. To delete a location criterion or a URL, click on the respective Delete icons.
- You can configure how you want the metric to measure the conversion using the following options:
- Unique Visitors - Each visitor, upon triggering the event, can be counted as converted only once, irrespective of the number of times the event is triggered by the same visitor. E.g. You can use this option to track if a visitor has clicked on a link.
- Event Totals - The event is counted as converted every single time a visitor triggers it. This way, it also populates multiple conversions made by the same visitor. E.g. You can use this option to track the total clicks on a CTA button, such as Add to Cart.
NOTE: The Event Totals option is not included with the VWO Data360 Growth plan.
- Value of an event property - Calculates the conversion of the event based on the property that you define. This can be used for those events that involve properties with numerical values, such as tracking revenue and time spent on a page. To apply this, you must define the event property and its corresponding value type (Sum, Average, Max, Min, First, and Last).
NOTE: In case of tracking revenue, select the Format this metric as currency checkbox. This populates the values in the currency (as configured in your workspace-level campaign settings. Read more) in your reports.
- To save the metric and apply it to your future campaigns, click on the Add this metric to Data360 for future use checkbox at the bottom left and click Create.
INFO: The saved metrics can be managed from Data360 > Metrics.
- Select the metric to apply to the campaign.
- To add any additional metrics, click Add secondary metric under the Secondary metrics section and repeat the steps of adding the primary metric.
Configure Your Integrations
On the Integrations page, you can apply to your campaign any third-party application integrations that you have already enabled in your account. If you haven’t yet integrated with any third-party application, click on Browse more integrations…, select the respective third-party application integration tile, and click on the Enable Now button to enable the corresponding integration.
Now your campaign is ready with all the fundamental requirements to be started. However, a typical campaign generally tends to be applied with certain ancillary configurations. This includes visitor segmentation, triggering of the campaign, scheduling the campaign, and many more. All of those ancillary configurations can be found under the More configurations dropdown as follows:
Audience and Traffic | Allows you to pre-segment the visitors to become the audience for your campaign and also allocate the traffic percentage for the individual variations. |
Triggers | Allows you to construct the condition for your campaign to be triggered based on the events performed by your website visitors. |
Schedule | Allows you to set up the schedule for your campaign. Select the Enable Scheduling checkbox and follow the steps mentioned here. |
Manual Activation | Allows you to set up custom conditions to activate your campaign for your website visitors. Select the Enable manual campaign activation checkbox and refer to this article to set it up. |
Mutually Exclusive | Allows you to add the campaign to a mutually exclusive group of campaigns so that the visitors of a campaign are not shown another campaign in that group. Select the Add to Mutually Exclusive Group checkbox and select an available mutually exclusive campaign group or create one by following this article. |
Privacy options |
Allows you to configure the following options:
For example, if you have a campaign named Test for Facebook users, VWO will replace it in this format - Test-numerical ID. NOTE: You cannot enable this option for the campaigns that are already running, paused, or stopped.
NOTE: Advanced options are not available if you are self-hosting the JavaScript files for the tests.
|
Hypothesis | Clicking on this opens the Hypothesis page, where you can create hypotheses for your campaign that will help you track the purpose of your campaign. Click Create a new hypothesis and perform the steps mentioned here to create a new hypothesis. |
Notes & Labels | Clicking on this opens the Notes & Labels page, where you can enter any important notes and add labels that would be helpful in maintaining a record of your observations of your campaign and collaborating with your team. Additionally, you can use a label as a search string to filter campaigns from the campaigns list. |
Reviewing Your Campaign
Once you have supplied all the required details for running the campaign, the Review tab on the left pane gets enabled and allows you to review your campaign configurations, preview your campaign and view the screenshots of your variations. It features the following sections:
- Configuration summary - Lists all the configurations that you have applied to your campaign. It includes all the essential and ancillary settings that were applied to your campaign. You can quickly run through the summary and make changes if necessary. Apart from that, if you’ve entered any URL that involves an unregistered deployment (domain), that will also be listed at the top of the page. You can click the Register link to register the deployment in your VWO account. Follow this article to learn more about Deployments in VWO.
- Live Preview - Allows you to preview your campaign variations.
- Variation Screenshots - Allows you to view the screenshots of the control and the variations that you have created. To view the screenshots, hover on the respective screenshot thumbnail and click View Screenshot. You can view the screenshots for different browsers by selecting the required options from the Select Browsers dropdown. By default, the screenshots are grouped based on browsers. You can switch the grouping to be based on variations by selecting the appropriate option from the Group by dropdown.
NOTE: If you’re viewing the screenshots for the first time, they may take a few seconds to generate, depending on the server load.
Managing Your Campaign
The following options are available on the left pane on the campaign creation page, allowing you to manage your campaign:
Click on this to view the timeline of the events and changes that were applied to your campaign | |
Click on this to clone your campaign | |
Click on this to flush your campaign data. TIP: We recommend that you do not flush the test data and run the same test again. Rather clone the test first, flush data from it, and implement the changes to the cloned test. To learn more about flushing your campaign data refer to this article. |
|
Click on this to archive your campaign. Archiving a test removes it from the dashboard, but you can still access it from the archived list. You can do this by applying the Archive filter on the A/B test dashboard | |
Click on this to delete the campaign. You can retrieve a deleted campaign by clicking on the retrieve link on the left pane and unarchive the same to view it in the campaigns list | |
Click on this to email the link to the campaign to your team | |
Click on this to print the campaign configuration summary | |
Click on this to download the campaign report data as a CSV file |
Post-requisite
To ensure that your Split URL test configurations are in place and work as expected for your website visitors, preview your variation before actually starting a test. This can be done using the PREVIEWS tab of your Split URL test campaign. Options present in this tab provide a convenient way to quickly check and validate your variations without digging through the entire test settings. To know more about previewing a test, refer to How to Preview Changes for a Test.
For example, say you have created a test that targets users from a specific geographic location. In such a scenario, the Previews option allows you to load the test pages in the same way as they load for the targeted visitor segment. This helps stimulate the experience, allowing you to ensure that the test is implemented correctly for targeted visitors.
VWO also lets you verify the goals that you have configured for your campaign. To learn how to do this, refer to Verify Goals Setup Using Live Previews.