What you can test
Reward value, reward type, the split between referrer and referee, minimum requirement and expiry.
Planning for Black Friday? See what a referral program could add to your sales.
Calculate my ROIRun your current reward against one variation, split new participants roughly 50/50, and let conversions decide. When you end the test, BLOOP applies the winner to the live campaign.
What it is
A reward too small never spreads, and one too generous quietly eats margin, and from the outside they look the same. An A/B test on a campaign compares two reward setups side by side. Control (A) is your current rewards, and Variation (B) starts as a copy you edit to test one idea.
You can change the reward value, type, the give-and-get split, the minimum requirement or the expiry on the referrer and referee side. Reward settings are locked while a test runs, so the result is not spoiled, and there is one active test per campaign.
For your customers
01
BLOOP assigns them to Control or Variation, roughly 50/50. They keep that assignment for the whole test.
02
Each referrer gets the reward setup for their group. Variation B can also carry its own display text, so wording can differ as well as value.
03
BLOOP records invites, store visits, coupon claims, orders and revenue for each side.
04
BLOOP shows the chance that Variation B beats Control A, a 95% range for the gap and the risk of switching. The read-out starts after 100 customers per variant and 7 days.
05
The winner's settings are applied to the campaign automatically.
For you
Steps follow the BLOOP user guide. Most stores finish setup in about 30 minutes.
Go to Referral program, open the campaign, then Overview, and choose View details in the A/B Testing section.
Read the guide →Click Create test and choose a test length of 2, 4 or 8 weeks. BLOOP estimates the smallest difference your recent traffic can detect. The audience split is fixed at 50/50.
Read the guide →In the variation settings, use Edit reward on the Variation column and change exactly one thing.
Read the guide →Click Start test, then wait until both sides have real volume. Settings are read-only meanwhile.
Read the guide →Choose a metric, then end the test and pick Control A or Variation B. BLOOP emails you when the result is ready, and a test that runs 14 days past its end date ends automatically and keeps Control A. An ended test cannot be restarted.
Read the guide →Options you control
Reward value, reward type, the split between referrer and referee, minimum requirement and expiry.
Customers with a referral order and customers who shared (the two main metrics, counted per customer), referral revenue, invites, store visits, coupon claims, referral orders, orders per invite, reward cost and revenue after rewards.
Reward cost sits under its own heading and never picks the winner, so you can see when a variant wins on referrals but gives away too much.
Variation B keeps its own reward display text, so you can test how an offer reads.
Referrers who were already active before the test started are excluded entirely.
Guides
FAQ
Until both variants have enough conversions to trust the gap. That depends on volume, not the calendar, and early leads often swap back and forth.
Start with customers with a referral order and customers who shared, which are counted per customer. Then check reward cost and revenue after rewards, because a variant can win on referrals and still lose money if it gives away more per order.
No. Tiers and A/B testing are mutually exclusive, so disable one to use the other.
Yes. Advanced A/B testing is included in the Free plan, which covers up to $400 per month in referral revenue.
More referral program features
Boost revenue, cut CAC, and build loyalty with BLOOP’s all-in-one referral & affiliate solution for Shopify.