Data
Spotify
Tue Mar 05 2024
Risk-Aware Product Decisions in A/B Tests with Multiple Metrics
TL;DR We summarize the findings in our recent paper, Schultzberg, Ankargren, and Frånberg (2024), where we explain how Spotify’s decision-ma...
software-development
Netflix
Tue Feb 13 2024
Sequential A/B Testing Keeps the World Streaming Netflix Part 1: Continuous Data
pinterest
Pinterest
Thu Jan 18 2024
Handling Online-Offline Discrepancy in Pinterest Ads Ranking System
Thu Sep 28 2023
How to Accurately Test Significance with Difference in Difference Models
When we want to determine the causal effect of a product or business change at Spotify, A/B testing is the gold standard.
Thu Aug 24 2023
Encouragement Designs and Instrumental Variables for A/B Testing
At Spotify, we run a lot of A/B tests.
Wed Aug 16 2023
Experimentation at Spotify: Three Lessons for Maximizing Impact in Innovation
As companies mature, it’s easy to believe that the core experience and most user needs have been resolved, and all that’s left to work towar...
Thu Aug 03 2023
Coming Soon: Confidence — An Experimentation Platform from Spotify
TL;DR: Spotify is releasing a new commercial product for software development teams: a version of our homegrown experimentation platform tha...
Tue Jul 25 2023
Bringing Sequential Testing to Experiments with Longitudinal Data (Part 2): Sequential Testing
In Part 1 of this series, we introduced the within-unit peeking problem that we call the “peeking problem 2.
Wed Jun 28 2023
Experimenting with Machine Learning to Target In-App Messaging
Messaging at Spotify At Spotify, we use messaging to communicate with our listeners all over the world.
two-sided-marketplaces
Lyft
Fri Feb 24 2023
Quantifying Efficiency in Ridesharing Marketplaces
experimentation
LinkedIn
Wed Dec 07 2022
Our Approach to Research and A/B Testing
We are constantly striving to improve the experience on LinkedIn for our members and customers, with research and experimentation, such as A...