Running a Price Test and a Theme Test at the Same Time
Price tests and theme tests can run concurrently, but your price testing integration must exist in every theme in the test. Here's how to set that up and QA it.
Yes — you can run a price test and a theme test at the same time, and an existing price test will keep running across both versions of a theme test. Visitors are randomized into each test independently, and orders are attributed to both.
There's one requirement that catches teams out: your price testing integration has to exist in every theme included in the theme test. If it doesn't, price tests will not work correctly for anyone who lands in the variant theme.
Why the two tests don't conflict
Price tests and theme tests operate on different layers:
A theme test controls which Shopify theme a visitor is served.
A price test controls what price a visitor sees, using your price testing integration plus Shopify Functions or Checkout Scripts at checkout.
Because they work independently, a visitor can be in both at once with no technical conflict — as long as the integration is present in whichever theme they're served.
The requirement: your integration lives inside your theme
Price testing is not powered by the Intelligems script alone. When your account was set up, we implemented a price testing integration for your store. Depending on your setup, that integration includes theme-level code such as:
Price tags on your product templates, collection pages, and any other surface that displays a price
Cart and cart drawer updates so test prices carry through correctly
Any custom handling needed for your theme, page builder, or third-party cart app
All of that lives inside your theme's code. A theme test serves some of your visitors an entirely different theme — so the integration has to be there too.
For the full detail of what your integration includes, see Price Testing Integration Guides.
What happens if the variant theme is missing the integration:
Price tests will fail silently for every visitor bucketed into that theme. You may see original prices instead of test prices, prices that don't update in cart, or a mismatch between the price on the page and the price at checkout.
Because those visitors are still counted in your price test, this contaminates both tests — your price test results will be diluted by visitors who never saw a test price, and your theme test results will reflect a pricing bug rather than the theme change you meant to measure.
Recommended setup
1. Build the variant theme by duplicating your live theme
Duplicate your current live theme and apply your changes to the copy. Do not build the variant from a fresh theme, an unmodified vendor theme, or a theme downloaded from a previous version of your store.
Duplicating carries your price testing integration over automatically, along with the Intelligems script and any other configuration your store depends on.
2. If the variant theme wasn't duplicated, re-apply the integration first
Some theme tests compare a genuinely new build — a redesign, a migration, or a theme developed separately by an agency. In that case the integration will not be present, and duplicating isn't an option.
Re-apply the price testing integration to the new theme before launching the theme test. Use Price Testing Integration Guides to confirm exactly what your setup requires, and reach out if you'd like us to review the implementation.
3. Confirm the Intelligems app embed is active on both themes
In the Shopify Theme Editor, open each theme in the test and confirm the Intelligems app embed is enabled. If your store uses a manual script tag instead, confirm the tag is present in theme.liquid.
4. QA prices in every theme before launching
Use a preview link for each theme in the test and confirm:
Test prices render correctly on product pages
Test prices render correctly on collection and search results pages
Prices update correctly when items are added to cart and in the cart drawer
The price shown on the page matches the price at checkout
Run this check for each test group, not just one. If prices look correct in your control theme but not the variant, the integration is missing or incomplete in the variant.
Other things to check
Template tests. If you have template tests running, the template files referenced by those tests must exist in both themes. A missing template file means the test cannot serve its variant to visitors in that theme.
Overlapping audiences. Running both tests concurrently means the same visitors are in both. That's usually fine — results reflect real-world combined impact — but if the theme change meaningfully affects purchase behavior, it can add noise to your price test read. If you need strict separation, Mutually Exclusive Experiments can isolate the two audiences. Note that this splits your traffic, so each test will take longer to reach a reliable read.
Ending a price test during a theme test. When you end a price test, Intelligems updates prices in Shopify. That applies at the product level and is not theme-specific, so no additional steps are needed for the theme test.
Related
Last updated
Was this helpful?