How to Set Up Campaign Tests

Intelligems enables your org to run real-time split tests on different promotions. This article will walk you through how to run a Campaign test with Intelligems, as well as some best practices. Lets get started!

Step 1: Create a new test

Navigate to the "A/B Tests" tab in the menu on the left-hand side of the Intelligems app. Once there, click 'Create New Test' above the experiments table. Select "Campaigns Test" and then "Create Test".

Step 2: Enter the test details

Fill in the Test Name and Test Description for the experiment you are creating. This information is all internal - the more detail you include here the better! Tests can be live for several weeks, and your future self will thank you for including the details here.

You will also select what your primary goal is - this will not impact what data is tracked or available to view, but will allow Intelligems to display analytics so that the most important information is surfaced first.

Step 3: Create your test groups

Create between two and five groups to include in the test by clicking on the β€˜+’ button. Name the groups for the experiment and use the slider at the bottom of the page to allocate what percentage of traffic will go to each group.

The more groups you have, the longer it will take to get statistically significant results. You’ll need about 300 orders for each group in the test to detect a 10% change in conversion with 90% confidence.

Step 4: Select which Campaign each group will be exposed to

Once you've added your groups, use the dropdown under each group to select which Campaign will be used for that group. You can select Campaigns that you have already set up, or create a new one by selecting "+ Create a Campaign" from the dropdown. See more here on how to set up a new Campaign.

Once you've selected your Campaigns, the details will be filled in in the table underneath. A few tips:

  • If you would like to test minor changes between your control and test groups, you can select the Campaign for your control and then select 'Duplicate Group' at the bottom of the table! This will allow you make those minor changes and save your test group Campaign quickly.

  • You can use the "Edit Details" button to make any changes to the Campaign you've selected directly from this page.

Step 4: Set up targeting if needed

Targeting is an optional step. This tool allows you to apply specific conditions to certain site visitors.

There are a few different ways you can do this:

  • You can set up currency and country targeting that allows you to limit your test to a single currency and/or a list of specific countries.

  • You can use UTM parameters to customize your user experience under the Audience option.

  • You can filter traffic based on JavaScript Expressions under the Audience option.

  • You can filter traffic based on device type (i.e. mobile or desktop) under the Audience option.

  • You can filter traffic based off of whether a visitor is new or returning under the Audience option.

  • You can prevent users from being targeted by related experiments to reduce undesired interactions under the Mutually Exclusive Tests option.

You can learn more about targeting here!

Step 5: Save your test

Once you have completed all the steps, you will be able to save your test with the button in the bottom right.

Don’t worry, this won’t set the test live yet and you can come back and edit if you need to make changes!

Last updated