Step 2: Create your test groups

Fill in the Test Name and Test Description of the experiment you are creating.

Put some detail in the name and description! Tests can be live for several weeks, and people do sometimes forget how they set things up. 🙂 Your later-self will thank you!

Create between two and five groups to include in the test by clicking on the blue + button. Name the groups - this won't be visible externally, but will help make the analytics dashboard clear.

The more groups you have, the longer it will take to get statistically significant results. You’ll need > 100-200 orders for each group in the test to be confident in the results.

Once you've added your groups, use the dropdown under each to select which Campaign will be used for that group. You can select Campaigns that you have already set up, or create a new one by selecting + Create a Campaign from the dropdown. See more here on how to set up a new Campaign.

Once you've selected your Campaigns, the details will be filled in in the table underneath. A few tips:

• If you would like to test minor changes between your control and test groups, you can select the Campaign for your control and then select 'Duplicate Group' at the bottom of the table! This will allow you make those minor changes and save your test group Campaign quickly.

• You can use the Edit Details button to make any changes to the Campaign you've selected directly from this page.

The last step in setting up your Campaign test is allocating what percent of traffic will go to each group. This will be set evenly by default, but you can adjust that using the slider at the bottom of the page.