Price Test QA Checklist

Use this checklist to QA every Price Test before hitting start!

This QA list is specific to a pricing test. If you are QAing a shipping test, please check out this article!

Before heading to your site, there are a few things you should check to make sure your integration is functional:

• Is Intelligems JavaScript in your live theme? Check out this article for more information on where to find this.

• If you are using the Checkout Script integration, is the Intelligems Checkout Script live in the Script Editor app?

Once you have confirmed both of those items are true, you can preview the test on your live site. Enter Preview mode by clicking the ... next to your test and select Preview

This will open your site up in a new window with the Intelligems preview widget enabled. In the preview widget, you will see:

1. The name of the test you are previewing in the top left

2. A dropdown to switch between different test groups in the bottom left

3. A toggle to highlight any replacements in the top right

4. An edit button in the bottom right - this enables integration mode where you can edit price selectors and text replacements

To get started in preview mode, turn the Highlight Replaces toggle on in the top right corner of the widget to highlight the prices in your test. This will highlight all of the prices that have been tagged on your site in green or blue.

• Confirm that any prices tagged in green are part of the test. Green highlighting means we recognize that element is a price, and it is being changed by the Intelligems app in accordance with the different groups for the test you are previewing.

• Confirm that any prices tagged in blue are not part of the test. Blue highlighting means we recognize that element is a price, but it is not being changed by the Intelligems app because that product is not included in the test you are previewing. This is important as you may test this price in the future, so we want to make sure we know it's a price.

  • Is the price of a product that is included in the test highlighted blue? This most likely means that we are not able to tell which product and/or variant ID this price is for. Follow these steps to add the data-product-id and/or data-variant-id to that price element so that we are able to tell which product it is for!

• Confirm that the price for each product and variant that are part of the test matches the test designed in the app for all test groups. You can switch groups with the drop down in the bottom left corner of the preview widget. A few pages we recommend checking:

  • Homepage

  • Collection Pages

  • Search Bar

  • Search Results

  • Product Page

  • Recommended Items on Product Page (i.e. You May Also Like or Recently Viewed)

  • Upsells in Cart

  • Product Quiz

  • Landing pages

• Confirm that the below is all true on the Product Page:

  • The correct price displays for each test group. Be sure to check out different variants if this is an option.

  • Bulk purchase and/or subscription options match the live site and/or test design.

  • Ratings and/or reviews match the live site.

  • Other media, such as images, video and text, match the live site.

  • Text is being updated if it references price. For example, text that says 20% off for subscriptions or references value of individual items in a bundle should update accordingly.

Now that you have confirmed prices look right everywhere on the site, go through the add to cart process and click checkout for a handful of products that are a part of the test.

• Confirm that status of duplicate products (if not on Shopify Plus) has been changed from Draft to Active.

• Confirm price is being calculated correctly at each step (i.e. in the mini cart, on the cart page and on the checkout page) based on which test group is selected in the widget. Note that if you are using Duplicate Products for your test, the price should be match the test group in the cart.

• Increase the quantity of a test item to two from within the cart - confirm that the prices are still correct.

• If you offer purchase options other than one-time, such as subscription or bulk, confirm those look correct at each step as well.

• If there is custom code for creating bundles within the site (i.e. if you add all the products that are part of the bundle and the discount is applied), confirm that functionality is working properly.

• If you have a quick buy button (i.e. Buy with ShopPay) on your home page, or anywhere else on the site, confirm that the price is correct in the cart when you use this functionality.

• Confirm that ig_discount or other ig_items are not showing in the cart or at checkout.

• Confirm that any payment plan options (i.e. AfterPay or ShopPay) are calculating monthly payments correctly if available.

• Compare shipping rates to the live site. This is most relevant if there are custom shipping rates set up.

• Add to cart from all landing pages from different test groups and confirm the price at checkout is correct

• For tests that include Subscription products, we highly recommend placing a test order, and checking the prices in your subscription app.

Check all of the above items in mobile as well. Here is a guide on how you can view mobile mode on your desktop on Chrome.

Once you have confirmed all of the above items look correct, you can hit start on your test in the app! Please reach out to [e-mail] if you have any questions.