Compare Campaigns

Overview

This tool allows you to compare two Campaigns side by side to easily understand how their engagement differs. This covers active vs. passive rates, opt-outs and #pauses, delivery failures, link clicks, and responses to interactive questions.

Selecting 2 Campaigns

There are two ways to select Campaigns for comparison.

List Page

1. From a Campaign List page, click the checkbox icon at the top.
   • 
2. Click the checkboxes next to two specific Campaigns.

   • 

3. Click Compare Results.

Campaign Insights Page

1. From an individual Campaign Insights report page, click the ... menu in the top-right.
   • 
2. Click Compare to... to launch the selection modal.
   • 
3. Click Compare.

Compare View

Either way, you'll be taken to a new page that shows the selected Campaigns side-by-side. This creates a unique URL, which you can bookmark or share with others.

Click the Swap A/B button to change which Campaigns appear on the left and right.

Overview

The first section provides details about the two Campaigns, including:

• names & descriptions
• Recipients (Audience or Import)
• Type (Interactive vs. Nudge)
• Script
• Trigger (Date & Time)
• Sent (# Recipients)
• Duration (based on Script Expiration)

Below this are three key performance indicators:

• Response rate: the percentage of recipients who interacted with the Campaign
• Links clicked: the percentage of recipients who clicked one or more short links
• Opt-out rate: the percentage of recipients who responded by opting out of future messages

Campaign Engagement

Next, the two Campaigns' main "buckets" are displayed, letting you easily see how many learners were Active, Passive, Opt-outs, Pauses, or Impacted by Failures. This reflects the same information shown in individual Campaign Insights pages.

Delivery Failures

This section shows learners who did not receive messages for various reasons.

• Send Failures prevented Mainstay from attempting to send the message, such as learners who were already opted out or had an invalid phone number.
• SMS Failures occur when our SMS provider (Twilio) reports that messages could not be successfully delivered, such as a phone carrier's spam filter or a phone number out of service. See Message Delivery Failures & Error Codes for more information.

Links Clicked

If one or both Campaigns contained mainst.ai short links, these will be shown here. Each link will indicate its full destination URL, as well as the number of clicks and the percentage of recipients who clicked.

Interactions

If one or both Campaigns included questions where learners could respond, these will be shown here. Yes/No and Multi-Choice questions will list out the available responses and the number of learners who selected each one, while Open-Text questions will only show the number of overall responses.

Use the dropdown menu to select specific questions to compare, even if they were not presented to learners in the same order.