A/B tests and scheduled offers

A/B tests

An A/B test splits your shoppers evenly between versions of one upsell or cross sell offer and counts what each version sells. Each shopper keeps the same version for their visits, so orders can be told apart.

1. Make sure the offer is switched on (Offers → Upsell offers or Offers → Cross sell offers).
2. Open Offers and, in the A/B tests section, click Open A/B tests.
3. Under Start a test, choose the Offer to test and give the test a name.
4. Change one thing for version B: the Headline, the Text under the headline, the Button (cross sells), the Discount label, the Discount, the tier discounts or the Style. Click Add a version for versions C and D, each with its own change.
5. Click Start the test.

Results count shoppers who saw each version, orders that added the offer, orders per 100 shoppers, revenue and revenue per shopper. The app says which version is ahead only once each version has been seen by 100 shoppers and the versions together have 10 orders; a small difference stays “No clear difference yet”. When there is a clear leader, click Use version B (or C, D) or Keep version A. Stop without choosing ends the test with no change.

More versions need more shoppers before a leader shows. If the cross sell also shows in the cart drawer, the drawer can only show version A’s discount: test the words and the style there, or take the drawer out of the offer to test the discount.

Scheduled offers

An offer can start and end at set times, like a weekend sale. It works for upsells, cross sells, bundle offers and discounts (Buy X get Y, volume discounts, free gifts).

1. Open the offer in the app.
2. In the Schedule card, switch on Start at a set time and pick the Start date and time. The offer is off until then.
3. Switch on End at a set time and pick the End. The offer is switched off then.
4. Save.

Times are in your store’s time zone (Shopify Settings → General). The app switches the offer on at the start and off at the end, once each: if you switch it by hand in between, your choice stays. The offers list shows when each scheduled offer starts or ends.

Plan

Both are on the Pro plan. See plans and billing and pricing. The guide how to A/B test upsell and cross sell offers covers what to test and how long to run a test.