Four Weeks Out, Lifecycle Teams Have Time for One Good Test Before Black Friday

With Black Friday approaching on Nov 27, retail email and SMS teams have limited time to make changes that could improve holiday revenue. Lifecycle leaders interviewed by CMO Wire recommend focusing on send times, offer structures and message frequency, where targeted experiments can produce actionable results before peak week.

How much testing time is left before Black Friday?

About two rounds. Attentive's A/B testing examples for SMS and email recommend running every test for at least two full weeks so results aren't skewed by day-of-week patterns, and setting the end date before launch. (The CMO Wire is powered by Attentive.) The same guide sets a floor of 3,000 subscribers per variant for SMS and warns that stopping early because one version is ahead can produce a false winner.

For most teams, that means a test started in the last week of October can produce a reliable answer by mid-November, with time to apply it before Thanksgiving week. Anything that needs a second round should start immediately.

Which test should come first?

Send time is the strongest candidate. Attentive reports that its customers who test send time alone see an average 8% lift in click-through rate and a 33% lift in conversion rate. The test is also simple to run, since the copy, offer and creative stay the same.

Eric Miao, then Attentive's chief strategy officer and now its CEO, described the reasoning in a June interview with CMO Wire. "Maybe you should text me at nine, because that's when I'm actually done with work and family," he said. He made the same case for the bottom of the funnel. "A standard journey might wait two days to send a follow-up message. But if a customer is showing high intent on a Friday near payday, you can't wait," Miao said.

Teams that can't personalize timing for each subscriber can still test a few fixed windows. Attentive's guide suggests 8 a.m. to 11 a.m. and after 7 p.m. for email opens, and noon to 3 p.m. for clicks, with SMS tested at hourly intervals once a strong window appears.

Should brands test offers before peak week?

Yes, though the useful offer test right now is about how the offer is structured. Attentive's list growth research found that sign-up units with a discount bring in roughly 55% more subscribers than a generic prompt. It recommends testing discount amounts in 5% steps and going no lower than 10%.

Brian Campbell, founder and CEO of CrucialPoint, argued in a September interview that most brands stop offering too early. He recommends carrying the welcome offer into broadcast and abandonment messages, split between buyers and non-buyers, and notes the offer can be a free add-on rather than a discount. "It's easier to get an email out with an offer than to think it through and map out the whole lifecycle," he said.

Format tests can pay off as well. Kuki Vincent-Osei, CEO of Republik Marketing, told CMO Wire that one client sent personalized audio messages in a cloned version of its founder's voice, which produced a 75% lift over standard text messages in early testing.

How should teams test message frequency?

By cohort, not across the whole list. Campbell's team found that frequency tolerance varies by brand and that sending to the same person too often hurts results sooner than most teams expect. A program can still send every day while capping each subscriber at a set number of messages per week, but only cohort-level reporting shows whether the cap is working. "If you look at the wrong metrics, it will show you that what you're doing is correct, when in fact it may not be," Campbell said.

Should SMS or email go first?

Sequence is worth testing because the two channels behave differently. Vincent-Osei said that with equal list sizes, SMS usually wins. "Even if the list size is the exact same with 100,000 on email and 100,000 on SMS, 90% of the time we're going to see a higher conversion rate and just better engagement overall in the SMS channel, and then ultimately more revenue."

The two channels also work in combination. Attentive's guide to combining SMS and email marketing describes a L'Occitane session abandonment journey that sends a text 15 minutes after a site visit and a more detailed email an hour later if the shopper hasn't returned. The brand reported a 382% increase in conversions. Finding the right interval between messages is important. In Attentive's cross-channel coordination research, 44% of shoppers who found multichannel messages annoying said the messages arrived too close together.

What should be locked before peak week?

Anything that can't be tested properly in the time left. That includes creative redesigns, new tools and major journey rebuilds. Campbell's audits regularly find revenue lost to broken segments, flows that stopped firing and sign-up forms that no longer pass data, problems that are easier to fix now than during Cyber Week.

The mobile checkout should also be settled. Vincent-Osei said a high click-through rate paired with weak conversion usually points to the purchase flow. "It shouldn't be a quiz for them to try to buy your product. It needs to be super easy for them to do it on their phone," she said.

The platform itself belongs on the list. In a September CMO Wire piece, Miao urged teams to ask vendors how their systems perform when volume jumps to several times normal traffic. CMO Wire's guide to email deliverability before Black Friday covers the sender requirements and checks to complete before volume rises.

FAQ

How long should an email or SMS A/B test run? At least two full weeks, according to Attentive's testing guidance, so results reflect a full range of weekday and weekend behavior. Set the end date before launch and don't stop the test early because one version is ahead.

How many subscribers do you need for an SMS A/B test? Attentive recommends at least 3,000 subscribers per variant for SMS. Email requirements depend on baseline open and click rates and on the size of the lift the team wants to detect.

What is the best thing to A/B test before Black Friday? Send time is a strong first test because it changes nothing else in the message. Attentive customers who test send time alone see an average 8% lift in click-through rate and 33% lift in conversion rate.

What is the difference between A/B testing and multivariate testing? An A/B test changes one variable and compares versions of it. A multivariate test changes several variables at once and needs far more traffic, typically five to ten times what an A/B test requires, which makes it impractical for most teams in the weeks before Black Friday.

Should SMS or email be sent first in an abandonment journey? Many retailers start with a short text soon after a shopper leaves the site, then follow with a more detailed email. L'Occitane's journey sends a text after 15 minutes and an email an hour later, and the brand reported a 382% increase in conversions.