Testing a Brand New Theme

Introduction

Your team has spent the last month perfecting a new theme for your store. They’ve spent hours QAing it and are confident that it is ready to launch. Testing this new theme compared to your live theme can be a great way to confirm whether the new theme is better than your old theme, and that no issues were overlooked. The goal of this test is to see either no difference, or some uplift, for the new theme. If there is a negative impact, this may be a sign that there are still bugs to work out.

You can use Intelligems to test your brand new theme by setting up a Theme Test. Before getting started, make sure you've added the Intelligems Script to all themes that will be included in the test. This allows Intelligems to hide the theme preview bar and track all data correctly.

Setting the Test Up

Theme tests allow you to test entire themes against each other using redirects. When a visitor lands on your website, they are randomized into a test group, and, if they're not in the control group, they'll be redirected to the test theme where they will stay for the remainder of the test. This test type is the only way to test two or more entirely different themes against each other, so it is the best option when you are looking to launch a brand new theme.

To set up a Theme Test for your new theme:

Create your new theme in Shopify. Make sure you've added the Intelligems Script to all themes that will be included in the test!
Create a new Theme Test by clicking "Create New Test" on the Intelligems homepage, then choosing "Content Test" and then "Theme Test"
Rename "New Group 1" to match the name of your new theme.
Select your live theme for the control group, and your new theme for the test group.
Save and preview your experiment. You can refer to our QA guide for tips on what to look for when testing.
Launch!

A few things to keep in mind while testing your new theme:

If the new theme is performing well, you can gradually increase the percent of traffic being sent to that theme by editing your test in the Test Groups tab:

Running a theme test means that you need to keep all themes that are part of the test up to date! Any changes that you make to your live theme while a Theme Test is running must also be made to any themes included in your test.
When you end a Theme Test, do not delete any themes that were part of the test. You can read more on why here!

PreviousLanding Page Testing NextTesting Different Imagery

Last updated 2 months ago

Was this helpful?

Introduction

Setting the Test Up

To set up a Theme Test for your new theme:

Create your new theme in Shopify. Make sure you've added the Intelligems Script to all themes that will be included in the test!

Create a new Theme Test by clicking "Create New Test" on the Intelligems homepage, then choosing "Content Test" and then "Theme Test"

Rename "New Group 1" to match the name of your new theme.

Select your live theme for the control group, and your new theme for the test group.

Save and preview your experiment. You can refer to our QA guide for tips on what to look for when testing.

Launch!

A few things to keep in mind while testing your new theme:

If the new theme is performing well, you can gradually increase the percent of traffic being sent to that theme by editing your test in the Test Groups tab:

Running a theme test means that you need to keep all themes that are part of the test up to date! Any changes that you make to your live theme while a Theme Test is running must also be made to any themes included in your test.

When you end a Theme Test, do not delete any themes that were part of the test. You can read more on why here!