Testing Offer Personalizations
Last updated
Last updated
Intelligems enables your org to run real-time split tests on different offers. This article will walk you through how to run an Offer test with Intelligems, as well as some best practices. Lets get started!
Navigate to the "A/B Tests" tab in the menu on the left-hand side of the Intelligems app. Once there, click 'Create New Test' above the experiments table. Select "Offer Test" and then "Create Test".
Fill in the Test Name and Test Description for the experiment you are creating. This information is all internal - the more detail you include here the better! Tests can be live for several weeks, and your future self will thank you for including the details here.
You will also select what your primary goal is - this will not impact what data is tracked or available to view, but will allow Intelligems to display analytics so that the most important information is surfaced first.
Create between two and five groups to include in the test by clicking on the ‘+’ button. Name the groups for the experiment and use the slider at the bottom of the page to allocate what percentage of traffic will go to each group.
The more groups you have, the longer it will take to get statistically significant results. You’ll need about 300 orders for each group in the test to detect a 10% change in conversion with 90% confidence.
Once you've added your groups, go to the Offer Details step.
Use the dropdown under each group to select an Offer Personalization to be used as a starting point for this group. An Offer Personalization is simply a Personalization that contains an Offer - regardless of what other modifications it contains. In an Offer Test, you are limited to choosing Offer Personalizations only.
You can select any Offer Personalizations you have already set up, so you should get these ready before you create your test. See more here on how to set up a new Personalization.
Once you've selected your Offer Personalization for each group, its details will be copied into the test group. You can see these in 1. This Offer Details step and 2. The Onsite Edits step at the end of the test setup.
In case you need to, you can modify the details as well before starting the test - or even after it's live.
Your chosen Personalization will remain untouched. It was simply used as a 'starting point' to copy offer details from. We recommend you don’t activate it while the test is running in order to avoid overlapping offers on your site.
Targeting is an optional step. This tool allows you to limit which site visitors should be exposed to your test. Intelligems offers a robust set of targeting tools:
Audience Targeting: limit your users based on their device, country, UTM parameters, landing page URL, new/returning, cookies, and much more.
Currency Targeting: Limit your test to a single currency and/or a list of specific countries.
Mutual Exclusion: Prevent users from being targeted by related experiments to reduce undesired interactions under the Mutually Exclusive Tests option.
You can learn more about targeting here.
A note on targeting: If you had any targeting options set on the Offer Personalizations you used to define your test groups, these will be ignored in lieu of test-level targeting.
Personalization-level audience targeting is ignored. The audience targeting used on the test (or lack thereof) is used in its place.
Personalization-level currency targeting is ignored. The currency targeting used on the test (or lack thereof) is used in its place.
Personalization-level page targeting is ignored. The page targeting used on the test (or lack thereof) is used in its place.
Once you have completed all the steps, you will be able to save your test with the button in the bottom right. You can then start it whenever you're ready.
Don’t worry, this won’t set the test live yet and you can come back and edit if you need to make changes!
