How to Set Up a Price Test

Check out the steps below to learn how to set up a price test!

Step 1: Create a new test

Navigate to the "A/B Tests" tab in the menu on the left-hand side of the Intelligems app. Once there, click 'Create New Test' above the experiments table. Give your test a name, add a description (optional), select 'Pricing Test' and then 'Create Test.'

Your test's name and description are internal details; the more detail you include here the better! Tests can be live for several weeks, and your future self will thank you for including the details here.

Step 2: Create your test groups

You can add new groups to include in the test by clicking on the ‘+’ button. Name the groups for the experiment and use the slider to allocate what percentage of traffic will go to each group. Click ‘Next step’ when you are done.

The more groups you have, the longer it will take to get statistically significant results. You’ll need about 300 orders for each group in the test to detect a 10% change in conversion with 90% confidence.

Step 3: Choose your products

In the 'Modifications' tab, click '+ Add/Remove Products' and select which products you want to include in the test by checking the boxes to the left of each product.

A few tips and tricks:

• You can select all products if you'd like to test your whole store, or all products matching the filters you have set up, by using the select all box at the top left-hand side of the table. Once you click the select all box, you will also need to click 'Select all 20+ products in your store'.

If you have subscription products, you may be missing the select all checkbox! Please reach out to Intelligems support for assistance with this.

• Use the search bar at the top of the table if you are looking for a specific product!

• The filter drop downs to the left of the table are helpful when looking for specific vendors, tags, product types, or statuses.

If you have 250+ Product Types, Vendors or Product Tags set up in Shopify, Shopify will not allow us to load them all. In this case, you can use the search bar in the Intelligems app to filter instead. For example, if you were looking for all products with the product tag 'Test', you would want to search for 'tag:Test'. For product type, you would use 'product_type:Test' and for vendor, you would use 'vendor:Test'. Please reach out to Intelligems support if you have any questions on this!

Once you have selected all necessary products, click 'Add' in the top right corner.

Step 4: Set the test prices

There are three different options for filling in your prices:

Uploading a Spreadsheet

This is best suited for cases where you have already set up your prices in a CSV or Excel file.

To upload a spreadsheet, first click on the 'Quick Fill' button, navigate to the 'Fill By Upload' tab, and then click 'Download Template'. Wait until we load the template, then click 'Template Ready - Click to Download' - your download will start automatically.

Using Microsoft Excel, Google Sheets, Numbers, or another spreadsheet editing tool, manually input the prices for the test groups and save the file with a .csv, .xls or .xlsx extension.

The following fields (columns) are required in the uploaded file.

• product_title

• product_id

• variant_title

• variant_id

• handle

• Price - [Test Group Name] (for each test group)

• Compare Price - [Test Group Name] (for each test group)

The rest of the fields in the template are provided for reference and are not required.

Back in the Intelligems app, click the 'Upload Prices' button and select the saved .csv, .xls or .xlsx file. Once it has uploaded, save the test to see the price changes.

Quick Fill

This is best suited for cases where you want to test uniform changes to all products in the test, such as a 10% or $10 dollar increase and decrease across all test products. Autofill is based on the control group product prices that are pulled in from Shopify.

To use this option, click 'Quick Fill', then configure the percentage or dollar amount change for each group and whether the change should be an increase or decrease relative to the control, as well as whether the amount should be rounded. Note that increase / decrease, the amount and % / $ selector are three separate fields. Click 'Apply All' when you are done.

Manually Set Prices

This is best suited for cases where you'd like to configure the prices for each product separately, such as a $10 increase to Product A and a $5 increase to Product B.

Input the prices and 'compare at' prices (if desired) for each product and test group in the table. You can drag prices from one cell to the next if the prices are the same.

You can expand all rows or collapse all rows by pressing 'Expand All' or 'Collapse All' at the top left of the table.

There are two relevant fields for each entry:

• Price: The price of the product; this is the price the user will actually be charged when they purchase the product in the given test group, before any discounts.

• Compare Price: Also known as the 'compare at price', this price will be shown as a strikethrough. This field is optional and there is no need to populate the 'Compare Price Field' if you do not wish to show a strikethrough. Your theme must be configured to show strikethroughs in order for Intelligems to display one.

Click 'Next step' when you are done setting up your prices.

Step 5 (optional): Set up targeting if needed

Targeting is an optional step. This tool allows you to apply specific conditions to certain site visitors.

There are a few different ways you can do this:

• You can set up currency and country targeting that allows you to limit your test to a single currency and/or a list of specific countries. This feature is defaulted to your store currency for price test.

• You can use UTM parameters to customize your user experience under the Audience option.

• You can filter traffic based on JavaScript Expressions under the Audience option.

• You can filter traffic based on device type (i.e. mobile or desktop) under the Audience option.

• You can filter traffic based off of whether a visitor is new or returning under the Audience option.

• You can prevent users from being targeted by related experiments to reduce undesired interactions under the Mutually Exclusive Tests option.

You can learn more about targeting here! Once you are done setting up targeting, or if you're skipping this step, click 'Next step'.

Step 6: Save + Preview your test

Once you have completed all the steps, you will be able to save your test with the green 'Save' button in the top right.

In the 'Preview' tab, you'll find a few options to load the test's preview:

• Open Full Screen Preview: this will open your website with the Intelligems widget loaded, so you can easily alternate between test groups to preview each group's experience, as well as do some edits if necessary (see step 8 for more details).
• Open Mobile Preview: you'll see a QR code for each test group, so you can load the preview directly on your mobile device. We'll also give you an option to copy the mobile preview URL, if you want to paste it in your mobile device, or share it with someone on your team.

• Copy Preview URL: this will copy the preview URL to your clipboard automatically.

Don’t worry, this won’t set the test live yet and you can come back and edit if you need to make changes!

Step 7 (optional): Set up your Goals

In the 'Goals' tab, you'll find the option to select what your primary goal is, as well as whether analytics should by default consider only orders containing certain products, or orders containing any products in your shop.

Neither of these choices will affect what data is tracked or available to view, but will allow Intelligems to display analytics so that the most important information is surfaced first. You can change this later after the test has started by changing the option in your Analytics filters.

Step 8 (optional): Edit content on your site if needed

This step is also optional. This tool allows you to dynamically update content on your site based on a visitor's test group. Check out this article for more details on configuring this option.

Please note this is not how you should update price components on your site for a Price Test - that should be completed by tagging your prices!

What happens next?

Now that you've created your pricing test, you can QA your test using this checklist! If you have not completed the integration yet, please see our integration guides here.