Use Case Walkthru: Website Checkout A/B Test with Apple Pay

Running experiments against e-commerce checkout flows is a common practice, used to improve the efficiency and effectiveness of the checkout process for users. Today, we walk through an example using Winning Variant on Snowflake AI Data Cloud.

The Hypothesis

Our sample experiment is testing whether adding an Apple Pay option to checkout increases conversion rate and decreases time to sale.

Experiment Setup

In the demo, we walk through the creation of Winning Variant assets inside of Snowflake, including a Lab, Subject Type, and Experiment. We also illustrate how easy it is to increment cohorts throughout the lifecycle of an experiment.

Analysis

Using sample experiment assignments and transaction data, we validate cohort assignment split, evaluate lift for the treatment variant with p-values, and consider secondary metrics before calling the experiment.

About Winning Variant

Winning Variant, a "Powered by Snowflake Startup Program" partner, is a software company focused on providing experimentation tools and services to companies of all sizes.

Many use Winning Variant's software to streamline their experimentation programs, including Winning Variant's Experimentation Engine - the only Snowflake Native App that looks and feels like an in-house experimentation platform.

The Winning Variant Native App is now available on the Snowflake Marketplace.