Intelligems Docs
  • Welcome to Intelligems
  • Getting Started
    • Getting Started
    • Adding Intelligems Script to your Theme
    • Updating the Intelligems Script
    • Common Use Cases
      • Price Test Common Use Cases
        • The Straddle
        • The Double Down
        • The Strikethrough
        • The Great Discount Debate
        • Savings Showdown: Volume Discount vs. Price Discount
      • Shipping Test Common Use Cases
        • The Flat Fee Face Off
        • The Threshold Trials
      • Content Test Common Use Cases
        • Landing Page Testing
        • Testing a Brand New Theme
        • Testing Different Imagery
        • Testing Cart Elements
        • Testing Announcement Bar Text
        • Navigation Menu
        • Testing Checkout Blocks
      • Offer Test Common Use Cases
        • The Volume Discount Duel
        • Gifting Games
    • Best Practices
      • 🧪Test Design Best Practices
      • ✅Best Practices During a Test
    • General FAQs
  • Price Testing
    • Price Testing - Getting Started
    • Price Testing Integration Guides
      • Integration Guide using Shopify Functions
        • Step 1: Add Intelligems JavaScript
        • Step 2: Tag product prices
        • Step 3: Update your cart
        • Step 4: QA your integration, and publish your changes
      • Integration Guide using Checkout Scripts
        • Step 1: Add Intelligems JavaScript
        • Step 2: Tag product prices
        • Step 3: Add the Checkout Script
        • Step 4: Update your cart
        • Step 5: QA your integration, and publish your changes
      • Integration Guide using Duplicate Products
        • Step 1: Add Intelligems JavaScript
        • Step 2: Tag product prices
        • Step 3: Hide duplicate products from collections pages
        • Step 4: Configure duplicate products
        • Step 5: QA your integration, and publish your changes
      • Troubleshooting
        • How to Add the data-product-id and/or data-variant-id Attribute to an Element
      • Replo Page Builder
    • How to Set Up a Price Test
    • Price Test QA Checklist
    • Starting a Price Test
    • Ending a Price Test
    • Testing Prices with Subscriptions
      • Testing Prices with Recharge 2.0 or Stay.Ai
      • How to Set Up a Price Test using Duplicate Products and Recharge Subscriptions
      • How to Set Up a Price Test using Duplicate Products and Skio Subscriptions
      • Managing Duplicate Products when Redirecting to Duplicate PDPs
    • Multi-Currency Testing
    • Price Testing FAQs
  • Shipping Testing
    • Shipping Testing - Getting Started
    • How to Set Up a Shipping Test
    • Shipping Test QA Checklist
    • Starting a Shipping Test
    • Ending a Shipping Test
    • Shipping Progress Bar Integration
    • Shipping Testing FAQs
  • Content Testing
    • Content Testing - Getting Started
      • How to Set Up a Split URL Test
      • How to Set Up an Onsite Edits Test
      • How to Set Up a Template Test
      • How to Set Up a Theme Test
      • How to Set Up a Test using our JavaScript API
    • Content Test QA Checklist
    • Ending a Theme Test
    • Content Testing FAQs
  • Personalizations
    • Personalizations - Getting Started
    • Personalization Modifications
      • Offer Modifications
      • Progress Bars
      • Offers: Integrating Widgets
      • Offers: Running a Large Number of Offer Personalizations with Shopify Functions
      • Theme Personalization Precautions
    • Targeting Personalizations
    • Targeting Modes for Personalizations
    • Previewing Personalizations
    • Testing Offer Personalizations
    • Offers Limits
    • Offer Combinations
    • Scheduling Personalizations
    • Rolling Out Tests
    • Personalizations FAQs
  • General Features
    • Targeting
      • Audience Targeting
      • Currency Targeting
      • Page Targeting
      • Mutually Exclusive Experiments
      • Targeting FAQs
    • Onsite Editor
    • Image Onsite Editor
    • CSS and JavaScript Injection
  • Analytics
    • Overview
      • How orders and sessions are attributed to experiments
      • Order and revenue accounting
      • How experiment targeting affects analytics
    • Analytics FAQs
    • Metric Definitions
      • Revenue
      • Conversion Funnel
      • Profit
      • Subscriptions
    • Filters
    • Statistical Significance
    • Timeseries
    • Custom Events
      • Overview
      • CSS Selectors
      • Scoping to specific pages
      • Custom Javascript Events
      • Testing Custom Events
      • Using custom events in experiment analytics
    • How to Add Profit to Intelligems Analytics
    • How to Add Product Groups to Intelligems Analytics
    • Tagging Orders by Test Group in Shopify
    • Exporting Data
    • Data Sharing
  • Performance Optimization
    • Site Performance
    • Optimizing Your Price-Test Integration
    • Anti-Flicker Modes
    • Edgemesh
  • Integrations
    • Google Analytics 4 Integration
    • Amplitude Integration
    • Heap Integration
    • Segment Integration
    • Heatmap Integrations
      • Integrating with Microsoft Clarity
      • Integrating with Heatmap.com
      • Integrating with HotJar
    • Navidium Testing
  • Developer Resources
    • Javascript API
      • User Object
      • Price Object
      • Campaigns Object
        • campaigns.getAll()
        • campaigns.getGWP(options)
        • campaigns.setHistoryStatus(params)
    • Intelligems Theme Snippets
    • Advanced Settings
    • Cart Permalinks
    • Targeting By Customer Parameters
    • Custom Add to Cart and Order Completed Events
Powered by GitBook
On this page
  • Step 1: Create a new test
  • Step 2: Enter the test details
  • Step 3: Create your test groups
  • Step 4: Select which Offer Personalization each group will be exposed to
  • Step 5: Set up targeting if needed
  • Step 6: Save your test and start it

Was this helpful?

  1. Personalizations

Testing Offer Personalizations

PreviousPreviewing PersonalizationsNextOffers Limits

Last updated 3 months ago

Was this helpful?

Intelligems enables your org to run real-time split tests on different offers. This article will walk you through how to run an Offers Test with Intelligems, as well as some best practices. Lets get started!

Step 1: Create a new test

Navigate to the "A/B Tests" tab in the menu on the left-hand side of the Intelligems app. Once there, click 'Create New Test' above the experiments table. Select "Offers Test" and then "Create Test".

Step 2: Enter the test details

Fill in the Test Name and Test Description for the experiment you are creating. This information is all internal; the more detail you include here the better! Tests can be live for several weeks, and your future self will thank you for including the details here.

You will also select your primary goal. This will not affect what data is tracked or available to view, but will allow Intelligems to display analytics so that the most important information is surfaced first.

Step 3: Create your test groups

Create between two and five groups to include in the test by clicking on the ‘+’ button. Name the groups for the experiment and use the slider at the bottom of the page to allocate what percentage of traffic will go to each group.

The more groups you have, the longer it will take to get statistically significant results. You’ll need about 300 orders for each group in the test to detect a 10% change in conversion with 90% confidence.

Step 4: Select which Offer Personalization each group will be exposed to

Once you've created your groups, go to the Modifications step. Here you will choose what kind of offers you're testing for each group. You can:

  • Leave a group untouched, as a no-offer group

  • Build an offer by choosing an offer type and other optional modifications

These details can be modified anytime during test setup and while the test is live.

Your chosen Personalization will remain untouched. It was simply used as a 'starting point' to copy offer details from. We recommend you don’t activate it while the test is running in order to avoid overlapping offers on your site.

Step 5: Set up targeting if needed

Targeting is an optional step. This tool allows you to limit which site visitors should be exposed to your test. Intelligems offers a robust set of targeting tools:

  • Audience Targeting: limit your users based on their device, country, UTM parameters, landing page URL, new/returning, cookies, and much more.

  • Currency Targeting: Limit your test to a single currency and/or a list of specific countries.

A note on targeting: If you had any targeting options set on the Offer Personalizations you used to define your test groups, these will be ignored in lieu of test-level targeting.

  • Personalization-level audience targeting is ignored. The audience targeting used on the test (or lack thereof) is used in its place.

  • Personalization-level currency targeting is ignored. The currency targeting used on the test (or lack thereof) is used in its place.

  • Personalization-level page targeting is ignored. The page targeting used on the test (or lack thereof) is used in its place.

Step 6: Save your test and start it

Once you have completed all the steps, you will be able to save your test with the button in the bottom right. You can then start it whenever you're ready.

Don’t worry, this won’t set the test live yet and you can come back and edit if you need to make changes!

Or start by copying the contents of a Personalization that contains an Offer. See more on how to set up a new Personalization.

Mutual Exclusion: Prevent users from being targeted by related experiments to reduce undesired interactions under the option.

You can learn more about targeting .

here
Mutually Exclusive Tests
here