What Atlas QA Checks
Overview
Atlas QA runs a fixed set of quality assurance checks, grouped into nine categories that always appear in the same order. Not every check runs on every test — Atlas QA only runs the ones relevant to your test type and skips the rest.
Below is what each check confirms when it passes.
Test setup
Saved settings
Your saved test settings are valid and up to date
Variation setup
Traffic percentages add to 100%, one control is assigned, and all variation names are unique
Control group offer
The control group has offer content to compare against
Traffic split
Traffic split
Traffic is going to more than one variation so the test can compare results
Targeting
Cart targeting rules
Cart targeting rules are valid and complete
Targeting logic
Targeting rules don't contradict each other or accidentally match too many pages
Page and audience match
Page rules and audience rules aren't working against each other
Theme test targeting
The theme test isn't accidentally narrowing who sees the control theme
Offer conflicts
Offer tiers
Offer tiers are filled in and don't overlap
Discount stacking
This offer won't stack unexpectedly with Shopify automatic discounts
Pricing
Price test setup
Pricing is enabled for this test
Control vs. variant price difference
At least one variant has a different price than control
Price math
All calculated test prices are positive, sellable amounts with no two variants landing at the same price
Compare-at prices
Every compare-at price is higher than the selling price so the strikethrough displays correctly
Subscription prices
Subscription discounts produce valid prices that are below the one-time price
Product price coverage
All products have prices set for every test group — no gaps
Prices across your store
Prices match the expected amounts everywhere on your store — PDP, collections, search, and more
Installation
Intelligems setup
Intelligems is installed once and pointing at the right store
Appearance
Test appearance
Your test changes are visible and working in every test group
Content changes
Content changes look right and aren't breaking anything on nearby pages
Phone vs. desktop
The test looks the same on desktop and mobile
Links, redirects, & hidden products
Preview links
Every preview link loads and lands on the right page
Redirects
Redirects work without looping and each variant shows different content
Hidden products
Duplicate products created for this test aren't visible to shoppers
Checkout
Cart and checkout prices
Cart prices, line totals, and subtotals all show the correct test group amounts
Offers and discounts
Offers, progress bars, and free gifts are working without conflicting with Shopify discounts
Shipping
Shipping rates and messaging look correct and consistent
Checkout appearance
The checkout page loads correctly and shows the right prices
Last updated
Was this helpful?