Script Experiments

Overview

This tool allows you to select two Scripts when sending a Campaign, split the Recipients across them, and then compare the results side by side, to easily understand how their engagement differs.

List Page

From the Campaigns tool, click Script Experiments in the sidebar. This shows a list of all Script Experiments, with the following columns:

• Experiment: The name and send date for this experiment.
• Scripts: The two Scripts selected for this experiment.
• Recipients: The Audience or Import this experiment will send to.
• Status: Whether the Experiment has sent or not.

Clicking on a sent (Complete) Experiment will take you to the results page (see below), while clicking on an upcoming (Scheduled) Experiment will re-open the Scheduler page so you can make edits.

Scheduler

From the list view, click Create Script Experiment in the top-right. This opens up the Scheduler view.

1. As with a standard Campaign, start by entering a Title and Description. If applicable, select a User Group Calendar for this to appear on (or "All User Groups").
2. On the Trigger screen, schedule the Experiment for a specific Date and Time.
3. On the Recipients screen, select an Audience or Import to send to.
4. On the Scripts screen, select two Scripts.

   • 

   • The list will indicate which Scripts you've selected with a checkmark, and the slots at the top will show the selected Scripts' names.

   • 

5. On the Split screen, use the drag handler to select the proportion of recipients who should receive each Script. You can also click one of the buttons to quickly snap the percentages to a common option.

   • 

   • Note that the expected number of recipients is calculated based on the current size of this group. When the scheduled date/time arrives, this may be different based on changes to your contacts' data.

   • 

6. Click Schedule Script Experiment when you're done. This returns you to the list page, with your new Experiment shown in the list.

Calendar

Script Experiments also appear on the Calendar page.

Each one will indicate:

• Status: For sent Experiments, this will show a lock in the top-right corner. For upcoming Experiments, you'll see an Edit pencil, allowing you to update your configuration.
• Name: For sent Experiments, this will link to the results page (see below).
• Description
• Trigger: Date, Time, Timezone
• Recipients: Audience or Import
• Scripts: Both the [A] and [B] Scripts will be shown, as links.
• Split: The % breakdown of recipients receiving the A and B Scripts.

Results

Clicking on a Script Experiment that has already sent will open the Compare Campaigns view, showing the results of each branch side by side. You can also click the name of an individual branch to see its standalone Campaign Insights page.

When viewing an individual Campaign Insights page for one branch of the Script Experiment, you can easily get back to the Compare Campaigns view showing both the A and B branch.

Audiences

In the Audience Builder, the rules can include whether learners received specific branches of a Script Experiment. Select Received Campaign IDs and then search for the Script Experiment by name; both the (A) and (B) branches are selectable.