Join us in Menlo Park on Oct 29 for The Agentic Marketing Forum. Register

Green A/B test graphic on a dark background

Knak Blog

Landing Page A/B Testing Statistics: Why Enterprise Testing Starts With Production

Jaina Mistry in

Director of Brand and Content

11 min read

Only 19.1% of the 2,288 A/B tests ConversionTeam audited produced a statistically significant winner. The variant goes live, the traffic splits, the weeks pass, and most of the time the result comes back too close to call. That is normal, even for a healthy testing program. If most tests come back empty, the winners a team finds depend on how many tests it gets live. Production sets the count.

Ask marketers what holds testing back and traffic comes first. It is a fair answer and a real limit: a page without enough visitors can't reach a verdict, however many variants it gets. The next answers on the list are resources and the time it takes to set a test up, and those describe production. At a large company, a new variant often waits on a web team's ticket queue, a brand review, and a legal read before it goes live. At Bing, a headline change that needed a few days of engineering sat in the backlog for more than six months, Harvard Business Review reported. Traffic is the barrier marketers name first, and production is the one the marketing team controls.

This page collects the primary-source evidence behind that read, with every figure linked or named at its original publisher.

Key landing page A/B testing statistics

  • 51% of marketers name limited traffic as their most common A/B testing challenge, in a survey of 402 marketers (Ascend2, 2025).
  • Landing pages are A/B tested by only 32% of marketers, well behind website and email testing (Ascend2, 2025).
  • Only 19.1% of 2,288 A/B tests produced a statistically significant winner when ConversionTeam audited its own client testing history (ConversionTeam, 2026).
  • Across onsite experiments run on one platform, 9.6% of concluded A/B tests were statistically significant (Wisepops, 2026).
  • 49% of enterprise marketing teams use dedicated tools for landing page production, against 36% for email production (Knak State of Marketing Production, 2026).
  • 85% of enterprise marketing teams missed at least one campaign launch date in the past 12 months (Knak, 2026).
  • A Bing headline change that sat in the backlog for more than six months raised revenue 12% once tested (Harvard Business Review, 2017).
  • Broadcom's marketers build a landing page in an average of 8.8 minutes from modular templates (Knak Broadcom customer story).

A/B testing barriers: Traffic, resources, and setup time

Traffic tops the list of what holds testing back, and it deserves to. Read one line further, though, and the next two answers are about capacity. The sample mixes B2B and B2C companies of every size, so these are figures for marketers overall.

  • Limited traffic for statistically significant results is the most common A/B testing challenge, named by 51% of marketers (Ascend2, 2025).
  • 47% name lack of resources, meaning time, tools, or budget (Ascend2, 2025).
  • Tests that take too long to set up, run, and analyze come third, cited by 38% (Ascend2, 2025).
  • 84% of marketers run A/B tests at least monthly (Ascend2, 2025).
  • Dedicated landing page A/B testing tools are how 40% of marketers run their tests (Ascend2, 2025).
  • Some go further: 34% of marketers have built custom internal testing tools (Ascend2, 2025).
  • A good conversion rate falls in the 1% to 10% range depending on what is counted, a dated benchmark (Nielsen Norman Group, 2013).

On a modest page traffic runs out fast, and one with 4,000 monthly visits needs almost five months to finish one two-version test. That follows from a standard rule of thumb (80% power, 95% confidence). Under it, a page converting 4%, inside the benchmark range above, needs roughly 9,600 visitors per variant to detect a one-fifth lift. On pages with more traffic than that, resources and setup time set the pace. Both are production problems, and fixing them doesn't take a single extra visitor.

How often landing pages get A/B tested

Marketers test the page campaign traffic lands on far less often than their website or their email. The habit is already there, and it stops short of the landing page.

  • Websites are the most tested channel, A/B tested by 60% of marketers (Ascend2, 2025).
  • Email marketing comes a close second at 57% (Ascend2, 2025).
  • 32% of marketers A/B test landing pages, well below both (Ascend2, 2025).
  • 46% of enterprise marketing teams produce landing pages as a campaign asset today (Knak, 2026).
  • Email is the dominant production channel, produced by 88% of enterprise marketing teams (Knak, 2026).

A team that already tests email every month has the discipline, and the landing page is the obvious next place to point it. Carry the habit over to your highest-traffic landing page first, working from a backlog of landing page A/B testing ideas sorted by the traffic each page gets. Every page brought into the program adds tests to the calendar, and every test is another chance at a winner.

A/B test win rates across audited datasets

Win rates are why volume matters, and three sources measured three different ways point the same direction: most tests end without a significant winner.

  • 19.1% of 2,288 A/B tests that ran to a win-or-lose result produced a statistically significant winner (ConversionTeam, 2026).
  • Wisepops found an even lower rate, with 9.6% of concluded onsite A/B tests on its platform statistically significant between January 2024 and June 2026 (Wisepops, 2026).
  • A declared winner is not always a significant one: of the experiments that declared a winner, 83% were statistically significant at p < 0.05 (Wisepops, 2026).
  • Almost two-thirds of companies report a significant winner in 30% of tests or fewer, a 2018 figure (Econsultancy, 2018).

Wisepops measures popups and embedded site experiences, and Econsultancy's figures are from 2018, so read the table below as a range.

Dataset

Sample

What was measured

Result

ConversionTeam (2026)

2,288 audited client A/B tests

Share of tests producing a statistically significant winner

19.1%

Wisepops (2026)

Concluded onsite experiments, Jan 2024 to Jun 2026

Share of tests statistically significant

9.6%

Econsultancy (2018)

Company survey

Companies whose tests produce a significant winner in 30% of cases or fewer

Almost two-thirds

At ConversionTeam's 19.1%, a program that launches a test every two weeks can expect about five significant results a year. One that launches a test a month can expect about two. Same rate, more significant results. The difference is how many variants production gets live.

Landing page production data from Knak's research

If volume decides the winners, the steps between a hypothesis and a live variant decide the volume. Knak's State of Marketing Production 2026 surveyed 333 enterprise marketing decision-makers about how their teams produce emails, landing pages, and digital assets. Its questions on people, tools, and review rounds were asked about a single marketing email, the closest measured stand-in for a landing page variant.

Landing page tooling sits apart from email

Split tooling is common, so a landing page variant often starts somewhere other than the email that sends traffic to it.

  • 49% of enterprise marketing teams use dedicated tools for landing page production, against 36% for email production (Knak, 2026).
  • 36% of teams use dedicated tools for both email and landing page production (Knak, 2026).
  • Custom HTML is how 28% of enterprise marketing teams build email and landing pages (Knak, 2026).
  • 26% of teams use the MAP's native editor (Knak, 2026).

Campaign approvals and launch blockers

The blockers enterprise teams name first are waits: for sign-off, for creative, and for other teams to line up.

  • 47% of enterprise marketing decision-makers name approvals and sign-off as a top challenge to launching campaigns on time, the most common answer (Knak, 2026).
  • Design and creative production is the second most common answer, at 38% (Knak, 2026).
  • 36% call coordination across multiple teams a launch challenge (Knak, 2026).
  • 85% of teams missed at least one campaign launch date in the past 12 months because of workflow constraints (Knak, 2026).
  • Sign-off still runs through email, Slack, or Teams threads at 51% of teams, ahead of dedicated project tools (Knak, 2026).

People, tools, and review rounds per email

A single marketing email is a group project at most enterprise teams, and every extra person, tool, and review round is a step a test variant waits on.

  • 60% of marketing teams involve four or more people in producing a single email (Knak, 2026).
  • Three to five separate tools go into a single email at 54% of teams (Knak, 2026).
  • 69% of organizations send a marketing email through two or three rounds of revision before approval (Knak, 2026).
  • B2B companies are twice as likely to call one revision round enough, at 27% against 13% overall (Knak, 2026).
  • A full business day or more goes into producing a single email at 36% of marketing teams (Knak, 2026).
  • 82% of marketing teams spend at least half their time on production rather than strategy and planning (Knak, 2026).
  • A hybrid structure, central governance with decentralized execution, is how 56% of organizations run production (Knak, 2026).

A landing page variant faces the same path, and if the page is built outside marketing, it also waits in a web team's queue. The test starts when the variant clears all of it. Teams that map where approvals sit in the campaign workflow can see which of those steps a pre-approved template removes for routine variants. Every review round a routine variant skips starts its test sooner, and none of it needs more traffic.

What developer dependence costs landing page tests

When a variant needs a developer, developer capacity sets the test count. Research on a dozen organizations shows the limit, and Microsoft's own experience at Bing shows how long a good idea can wait.

  • When variations depend on developers, the shortage of developer time limits how many experiments get run, across a study of 12 Dutch organizations (Delft University of Technology, 2020).
  • A Bing headline change that needed a few days of an engineer's time sat in the backlog for more than six months (Harvard Business Review, 2017).
  • Once tested, the same change raised revenue 12%, worth more than $100 million a year in the US alone (Harvard Business Review, 2017).
  • Google Cloud cut campaign change requests by 90% after rethinking how its marketers produce email (Knak, 2026).
  • 8.8 minutes is Broadcom's average time to build a landing page from modular templates with locked design elements (Knak Broadcom customer story).

Natasha Skibinsky, Director of Digital Marketing Technology at Broadcom, says in the customer story that her lean team can now "deliver compliant, on-brand landing pages at scale," and do it "without needing developers or agencies."

The Bing headline is the whole argument in one story: a winning idea, a few days of work, and more than six months in a queue. The usual landing page tests change copy, imagery, section order, the offer, or form length, and none of those needs a developer when marketers build landing page variants from locked templates that already connect to the MAP and its forms. Developers stay on the work that needs them, such as form logic, tracking events, personalization rules, and page speed, and the test count stops depending on a sprint plan.

How enterprise teams measure landing page tests

What a team measures decides which tests it can call and how fast. Almost every enterprise team measures something, so the real decision is which step a test gets called on.

  • Click-through rate is the most common way enterprise teams judge email and landing page performance, used by 69% (Knak, 2026).
  • 58% track conversion rate for email and landing pages (Knak, 2026).
  • Revenue or pipeline influenced by email and landing pages is tracked by 41% (Knak, 2026).
  • Only 3% of teams have no formal tracking for email and landing page performance (Knak, 2026).

Pick the metric before the test launches, and on a page with thin traffic, call the test on a step with more volume, such as form starts, so it can reach a verdict within the quarter. A test that never reaches a verdict adds nothing to the count, however fast production shipped it.

Where to start with landing page testing this quarter

Start with a traffic inventory that lists every live campaign landing page and template with its monthly visits. Pool the pages too thin to test alone with their siblings on the same template and test the template instead. Then count how many finished tests the remaining pages and templates could support before the quarter ends, and set that number against the variants that are built and approved today. The gap between those two numbers is production work, and it belongs to the marketing team.

Knak is the agentic production layer for enterprise marketing. It's the system between creative brief and send, where your team and AI build on-brand campaigns that are more personalized, more tested, and live in days. For a testing program, that means landing page variants produced from approved modules under the same brand controls as email and synced to the MAP. The MAP or testing tool still runs the split, and the campaign still brings the traffic.