CoFeed

Netflix

Improve Your Next Experiment by Learning Better Proxy Metrics From Past Experiments

Booking

The Engineering Behind Booking.com’s Ranking Platform | A System Overview

Canva

How we build experiments in-house

Experimentation and experiment analysis are vital procedures at Canva to safeguard the customer experience.

Netflix

Round 2: A Survey of Causal Inference Applications at Netflix

Spotify

Fixed-Power Designs: It’s Not IF You Peek, It’s WHAT You Peek at

TL;DR Sometimes we cannot estimate the required sample size needed to power an experiment before starting it.

Spotify

Risk-Aware Product Decisions in A/B Tests with Multiple Metrics

TL;DR We summarize the findings in our recent paper, Schultzberg, Ankargren, and Frånberg (2024), where we explain how Spotify’s decision-ma...

Netflix

Sequential A/B Testing Keeps the World Streaming Netflix Part 1: Continuous Data

Pinterest

Handling Online-Offline Discrepancy in Pinterest Ads Ranking System

Spotify

How to Accurately Test Significance with Difference in Difference Models

When we want to determine the causal effect of a product or business change at Spotify, A/B testing is the gold standard.

Spotify

Encouragement Designs and Instrumental Variables for A/B Testing

At Spotify, we run a lot of A/B tests.

Spotify

Experimentation at Spotify: Three Lessons for Maximizing Impact in Innovation

As companies mature, it’s easy to believe that the core experience and most user needs have been resolved, and all that’s left to work towar...

Spotify

Coming Soon: Confidence — An Experimentation Platform from Spotify

TL;DR: Spotify is releasing a new commercial product for software development teams: a version of our homegrown experimentation platform tha...

Spotify

Bringing Sequential Testing to Experiments with Longitudinal Data (Part 2): Sequential Testing

In Part 1 of this series, we introduced the within-unit peeking problem that we call the “peeking problem 2.

Spotify

Experimenting with Machine Learning to Target In-App Messaging

Messaging at Spotify At Spotify, we use messaging to communicate with our listeners all over the world.

Lyft

Quantifying Efficiency in Ridesharing Marketplaces

LinkedIn

Our Approach to Research and A/B Testing

We are constantly striving to improve the experience on LinkedIn for our members and customers, with research and experimentation, such as A...