Smart A/B tests

Applies to: TreStack Bundles, every plan
Updated: 11 October 2026

What it is

Smart A/B test is a shortcut to an A/B test. Variant A is your deal as it is saved, and variant B is a copy with one change you pick. "Run A/B test" saves both and publishes the test at once, with an even split, and the editor opens on variant B. From then on it is an ordinary A/B test: the same results in the deal list, the same winner rule, Set winner and Stop A/B test.

The options and suggestions come from fixed rules that read the deal's settings and today's date in your browser, for example a badge text for the season or the weekend. They are not AI, and they do not use results from your store or any other. Some options carry a tag in the list ("Top performing" on Badge, "New" on Savings summary, "Trending" on Scratch-off); these tags are fixed labels, not measurements.

Plans. Smart A/B test is in every plan, like every feature. It is offered by the rules under "Where it is offered", not by plan. Like any save, starting a test needs a plan or a development store.

What it can test

The modal lists the options your deal qualifies for, in this order, and shows at most six: on a deal that qualifies for more, the last ones are left out. Badge, Highlights and Discount change the 2nd bar only, as the modal says.

The details behind the choices:

• Badge: suggestions change with the date: holiday texts from late November to early January, weekend texts from Thursday to Sunday, FREE SHIPPING when a free shipping gift unlocks at the 1st or 2nd bar, SAVE {{saved_percentage}}, a season text, then a rotating set of general texts (urgent ones first when the deal has a timer). Texts a badge already has are left out. Badges show only in the Vertical layout, so on a deal in another layout B's badge does not appear on the storefront.
• Highlights: FREE SHIPPING shows when a free shipping gift unlocks at the 1st or 2nd bar, and FREE GIFT INCLUDED when the 2nd bar has a gift product. Lines the 2nd bar already has are left out.
• Discount: it is not offered when another quantity break or Buy X, get Y bar has the same number of items as the 2nd bar, or when subscriptions are on in the Vertical or Plain layout. For a percentage, the values step by 1, 2 or 5 points around the current one, between 1 and 30 percent (up to 50 near the top). For an amount off, they are 0.8, 1.2, 1.4 and 1.6 times the current amount; for a fixed price, 0.8, 0.85, 1.15 and 1.2 times, keeping the cents. A value another quantity break with the same price type already has is left out.
• Scratch-off: the bar choices depend on how many bars the deal has.
• Timer: only deals that already had a Fixed duration or Ends at midnight timer get this option. New timers count to an end date and are not offered. The current setting is left out of the choices.
• Sticky add to cart, Subscriptions and Block title: the text the deal already uses is left out.

Where it is offered

• In the deal list, as a "Smart test" button on the row and "Smart A/B test" in the deal's menu, for a deal that is Active, has no A/B test open (running, or saved and not started), and is either less than 7 days old or has at least 100 visitors in the list's last 365 days.
• In the editor, as a "Smart A/B test" button above the preview next to Setup A/B test, right after you publish the deal, as long as it has no variants and no unsaved edits.

Running a smart test, in four steps.

Settings reference

If this does not work

The failures most likely with a smart test, with the check that resolves each one.