Use Copilot Learnings in A/B Tests

Overview

The Copilot Learnings feature is an AI-powered capability in VWO that automatically analyzes and summarizes the results of your completed or paused A/B testing campaigns. Once your campaign concludes or you pause it, VWO Copilot processes all available data, including metrics, goals, and user behavior insights, to generate a concise, actionable summary of campaign impact, cause, and recommended next steps.

At a high level, this feature allows you to:

• Quickly Understand Campaign Outcomes: Get a clear, Copilot-generated summary of your campaign results within minutes. For example, a marketing manager pauses an A/B test and, within 5-7 minutes, receives a full summary explaining which variation won and why, along with recommended next steps, reducing the need for manual analysis.
• Collaborate and Align Your Team: Save a key learning from a test. The feature stores it in a shared repository for that campaign, ensuring the entire team is aligned on the outcome and future direction.
• Seamlessly Plan Future Tests: You can turn the Copilot-generated learnings of a campaign directly into a new, well-structured hypothesis and add it to your Hypothesis hub for the next testing cycle.

Use Copilot Learnings

To access the Copilot Learnings feature:

1. Navigate to the A/B Tests view and filter out the paused or concluded campaigns.
   From the available campaigns, those that include insights or observations generated by Copilot Learnings are marked with the Copilot learning available label.
   
2. Click on the campaign of your choice to open its detailed report. At the top of the report, you will find the Copilot suggested learning card. This card contains a summary of the test, key findings, and recommendations.
   
3. Click Save learning on the summary card. This adds the insight to a permanent, shared repository for this specific campaign. Click in the report header to access or edit all your saved learnings.
4. Alternatively, you can click Explore with Copilot. This feature opens a VWO Copilot chat widget, pre-loaded with the context of the campaign and its learning summary. 
   You can use this chat window to dig deeper into your campaign data. You can ask follow-up questions to gain a deeper understanding of the results. 
   Here are some sample prompts to help you get started:
   • Give me a deep dive report of this campaign.
   • Can you make this learning a bit shorter?
   • Turn this into a hypothesis for my next experiment.
     

Based on your learnings, you can also ask the Copilot to frame a formal hypothesis for your next test. Once generated, you can directly add it to your organization's hypothesis hub.

Troubleshooting

Issue	Solution
Copilot learning available label does not appear for my campaign.	Ensure the campaign is paused or in a concluded state. The learning generation process takes about 5-7 minutes after a campaign is paused or concluded. Please wait a few minutes and refresh the page. Note that this feature is not available for running campaigns.
I can't find my saved learnings.	Saved learnings are specific to each campaign. Navigate to the campaign's report page and click on the journal icon   located in the top-right area of the metrics section to view all saved learnings for that campaign.

FAQs

• Do I need to take any action to enable this feature?
  No, it is enabled by default. Learnings are automatically generated for any A/B test that is paused or concluded.
   
• Who can see the learnings I save?
  Saved learnings are available within the campaign reports and are visible to all users in your VWO account who have access to that campaign's report.

Need more help?

For further assistance or more information, contact VWO Support.