A/B Test Email Campaign

With A/B Test Campaigns, you can now test up to 6 different versions of an email campaign with your recipient list. By testing multiple variations of your email campaigns, you can get valuable insight to help create content that resonates with your audience and drives them to action.

Note: A minimum 10 contacts are needed for each variation. So creating 4 emails to split test would require 40 contacts, 10 for each test.

  • A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedule.

  • During the duration that is set, if there were no results for click or open rate as chosen, by default the first variation will be sent out as winning variation.

How A/B Test Email Campaigns work

  • Choose one element to test, such as your email subject line **** or email content.

  • Set the number of variations to be tested - A maximum of 6 variations **** can be tested

  • Set the duration for when the test should run - Test duration can be set from 30mins to 24 hours.

  • Select the sample size of recipients for the test (each variation will be sent to exactly half of the sample)

  • Choose the method for determining the winner: open rate or click rate.

How to Set up an A/B Test Email Campaign

Go to Emails under Marketing then Select "Create Campaign".

Choose Templates

Choose the email template you will like to use, then click on the Checkmark icon. You can also check the preview of the email template by clicking on the Preview icon.

Select the Your Editing Experience

Choose to build using our visual drag-and-drop design editor or powerful code editor.

Edit A/B Testing

After creating a new Email Campaign, there is an option to enable "A/B Testing". Maximize engagement by sending up to 6 variations of either your subject line or email content to a portion of your users. Then, send the winning variation to the rest!

Note: A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedules.

Email Subject Line (Optimize Open Rates)

It is necessary to play around with the length of the subject line or add personalization to get better open rates. Email subject lines are the first thing the recipients will see when receiving an email campaign since subject lines are visible to them before they even open your campaign.

Email Content (Optimize Click Rates)

You can test different elements in the campaign content that could influence or not the conversion or action from the recipients, like different section titles, article length, call-to-action buttons, images, videos, and more.

Choosing the A/B Test Duration time frame

A/B testing is a key part of any email marketing strategy, and the proper selection of the duration time frame is essential to success. It is important to consider how long it will take for customers to recognize, read, and act on emails when determining the duration time frame, as this can impact your results.

In this step, you can select the time period after the combinations are sent out, compared to the results for open rates or click rates.

Data collected during the test phase can be used to determine the email campaign's winning combination. Test duration is between 30mins to 24 hours.

Note: During the duration that is set, if there were no results for click or open rate as chosen, by default the first variation will be sent out as winning variation.

Choose the Winning Criteria

Select which winning metric you want to measure: Unique Open Rate or Unique Click Rate.

Testing your A/B Split test

Once the A/B Test emails are prepared, and you are happy, you may test the email campaign or preview the campaign by clicking on the 3 dots.

To publish/launch your campaign to the selected receipts, please set the delivery method to either 'Send Now' or 'Schedule For Specific Date/time'.

Note: A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedule.

Note: A/B test campaigns can be only sent via using send now or scheduling the campaign. It will not work for batch schedule or RSS schedule.

Last updated