In this article, you’ll learn: |
About Personalize Reports
A VWO Personalize campaign report consists of the statistical data of the campaign outcomes such as Current Traffic Split, Expected Conversion Rate, and Conversions/Visitors numbers. These data are presented in tables and graphical models, as well.
Accessing Personalize Reports
To access your Personalize campaign report, go to PERSONALIZE, and select the campaign for which you want to view the report. You can view the report for your campaign under the Report tab.
It features two sections - Report that highlights the outcomes of your Personalize campaign and Filters that can be applied to the results for targeted study.
Applying Filters to Your Report
As an initial step, you need to set up your filter to view the corresponding report. You can set up the date range, segment of visitors, and visitor dimensions to fetch the data accordingly.
Viewing the Report for a Date Range
Date filter enables you to filter data for the specified date range. To specify a date range, you can either use the existing options or can specify a custom date range using the calendar control.
Viewing the Report for Specific Visitor Segments
To filter the report by visitor segments, click the All Visitors drop-down menu and select the segment you want to apply. You can use the Segment Gallery (default VWO segments) or filter the report per the segment you want to apply. To know more about creating and applying custom segmentation, refer to Using Segmentation in VWO.
To learn how to create a custom segment, click here.
Viewing the Report for specific Visitor Dimensions
To filter the report by visitor dimensions, click the Visitor Dimensions drop-down menu and select the visitor dimension you want to apply. To know more about creating and applying Visitor Dimensions, refer to Breakdown Test Reports by Visitor Dimensions in VWO.
Understanding the Report Table
The report table displays the data collected for each experience in the campaign. You can disable the experiences or preview the experiences to verify your campaign settings using Disable Experience and Preview Experience options, respectively from the vertical ellipsis icon (⋮) present at the right end of the table row. The Disable Experience option can be used when you want to pause or stop an experience from being served. However, the experience will continue to be served to the returning visitors who have already been served this experience earlier.
The report table presents the results for individual experiences with the following parameters:
Visitor Segment: This displays the visitor segment that you have configured for the given experience.
Current Traffic Split: This displays the percentage of the portion of traffic that is served the given experience. This is also based on the randomness or the prioritization settings that you have configured in the Tiebreaker for Multiple Qualifications section on the TARGETS page for overlapping segments.
Expected Conversion Rate: This is the median conversion rate you can expect from the experience. The "best case" and "worst case" conversion rates represent the 99% credible interval where the conversion rate is likely to be contained.
Conversions/Visitors: This is the ratio of the total number of visitors who recorded conversion for the respective goal to the total number of visitors who were served a given experience.
Expected Revenue per Visitor: This is the median revenue per visitor you can expect from the experience. The "best case" and "worst case" revenue per visitor values represent the 99% credible interval, where the revenue amount per visitor is likely to be contained.
Expected Revenue per Conversion: This is the median revenue per conversion you can expect from the combination. The "best case" and "worst case" revenue per visitor values represent the 99% credible interval where they are most likely to be contained.
You can choose to filter the experiences and sort the data based on the parameters. Just click on the required parameter on the header row to sort the data in the ascending/descending order.
The report table comes with the following features along with the campaign stats:
This is the Refresh option that upon clicking updates the data to the current state. | |
This displays any Warnings that you should be aware of. It also displays the number of warnings. Warnings are displayed if errors were made during the course of the campaign, which can impact your report's data integrity. For example, if you modify a campaign after it starts running. | |
This displays the Learnings that you have deduced from the report. You can create a Learning by clicking on this icon and selecting the Add new learning option. |
Understanding the Graph View
The graph provides information on the conversion rate, conversions, and visitors over the configured period of time. To view the graph for a different period of time, visitor segment, or visitor dimension, modify the report filters appropriately.
The graph section contains the following two parts:
- Date Range - This features the conversion rates, conversions, visitors, and revenue per visitor data.
- Traffic Split - This features the split of the overall traffic for each experience.
Interpreting the Date Range Graph
Using the Date Range graph you can read the conversion rates, conversions, visitors, and the revenue per visitor by configuring them in the dropdown at the top-left of the graph.
In case of selecting the Conversion Rate (%) option, the Show ranges option appears at the top-right of the graph. The Show ranges option displays the median, the best case and the worst case values of the expected conversion rate corresponding to the experience. Through this, you can also figure out the uncertainty overlap an experience may share with the others.
The example in the image below shows the comparison among the experiences (E1, E2, E3, and E4). Each version is highlighted in a different colour that is indicated at the bottom of the graph. Initially, all the versions are at mark zero. As soon as the inflow of visitor traffic starts, data collection begins, and the conversion rate is tracked. Based on the data collected over time, the change in graph pattern could be seen.
In the above graph, the x-axis represents the dates, and the y-axis represents the conversion rate.
Interpreting the Traffic Split
The overall traffic to your campaign is represented by the donut that is divided into different portions based on the number of experiences. The size of each portion represents the percentage of the amount of traffic that receives that experience.