CoFeed

Cloudflare

Cloudflare incident on November 14, 2024, resulting in lost logs

On November 14, 2024, Cloudflare experienced a Cloudflare Logs outage, impacting the majority of customers using these products.

Spotify

How We Generated Millions of Content Annotations

With the fields of machine learning (ML) and generative AI (GenAI) continuing to rapidly evolve and expand, it has become [.

Airbnb

Riverbed Data Hydration — Part 1

Spotify

Are You a Dalia? How We Created Data Science Personas for Spotify’s Analytics Platform

On Spotify’s Analytics Platform, we’re dedicated to building products that empower data practitioners to discover, analyze, and share insigh...

Spotify

Unlocking Insights with High-Quality Dashboards at Scale

We have a lot of dashboards at Spotify.

Airbnb

Personal Data Classification

Netflix

Maestro: Netflix’s Workflow Orchestrator

Netflix

A Recap of the Data Engineering Open Forum at Netflix

Spotify

Data Platform Explained Part II 

Check out Data Platform Explained Part I, where we started sharing the journey of building a data platform, its building [.

Spotify

Fixed-Power Designs: It’s Not IF You Peek, It’s WHAT You Peek at

TL;DR Sometimes we cannot estimate the required sample size needed to power an experiment before starting it.

Airbnb

Chronon, Airbnb’s ML Feature Platform, Is Now Open Source

Spotify

Data Platform Explained

As engineers working at Spotify, we frequently find ourselves explaining our robust data platform to fellow professionals who are contemplat...

Spotify

Risk-Aware Product Decisions in A/B Tests with Multiple Metrics

TL;DR We summarize the findings in our recent paper, Schultzberg, Ankargren, and Frånberg (2024), where we explain how Spotify’s decision-ma...

Expedia

Search Speed: Making Expedia Flights Faster

LinkedIn

Deployment of Exabyte-Backed Big Data Components

Co-authors: Arjun Mohnot, Jenchang Ho, Anthony Quigley, Xing Lin, Anil Alluri, Michael Kuchenbecker LinkedIn operates one of the world’s lar...

Netflix

Our First Netflix Data Engineering Summit

Cloudflare

ML Ops Platform at Cloudflare

Spotify

Recursive Embedding and Clustering

Large sets of diverse data present several challenges for clustering, but through a novel approach that combines dimensionality reduction, r...

Airbnb

Data Quality Score: The next chapter of data quality at Airbnb

Expedia

Powering People’s Data with an Enterprise Platform

Netflix

Incremental Processing using Netflix Maestro and Apache Iceberg

Airbnb

Wisdom of Unstructured Data: Building Airbnb’s Listing Knowledge from Big Text Data

Netflix

Psyberg: Automated end to end catch up

Netflix

Diving Deeper into Psyberg: Stateless vs Stateful Data Processing

Netflix

1. Streamlining Membership Data Engineering at Netflix with Psyberg

Spotify

Introducing Voyager: Spotify’s New Nearest-Neighbor Search Library

For the past decade, Spotify has used approximate nearest-neighbor search technology to power our personalization, recommendation, and searc...

Lyft

From Big Data to Better Data: Ensuring Data Quality with Verity

Expedia

Using Synthetic Search Data for Flights Price Forecasting

Spotify

How to Accurately Test Significance with Difference in Difference Models

When we want to determine the causal effect of a product or business change at Spotify, A/B testing is the gold standard.

Spotify

Encouragement Designs and Instrumental Variables for A/B Testing

At Spotify, we run a lot of A/B tests.

Spotify

Experimentation at Spotify: Three Lessons for Maximizing Impact in Innovation

As companies mature, it’s easy to believe that the core experience and most user needs have been resolved, and all that’s left to work towar...

Lyft

Where’s My Data — A Unique Encounter with Flink Streaming’s Kinesis Connector

Spotify

Coming Soon: Confidence — An Experimentation Platform from Spotify

TL;DR: Spotify is releasing a new commercial product for software development teams: a version of our homegrown experimentation platform tha...

Spotify

Bringing Sequential Testing to Experiments with Longitudinal Data (Part 2): Sequential Testing

In Part 1 of this series, we introduced the within-unit peeking problem that we call the “peeking problem 2.

LinkedIn

Taking Charge of Tables: Introducing OpenHouse for Big Data Management

Co-Authors: Sumedh Sakdeo, Lei Sun, Sushant Raikar, Stanislav Pak, and Abhishek Nath Introduction At LinkedIn, we build and operate an open ...

Spotify

Bringing Sequential Testing to Experiments with Longitudinal Data (Part 1): The Peeking Problem 2.0

Spotify’s approach to challenges in sequential testing with longitudinal data  At Spotify, we’re constantly improving our data infrastructur...

Spotify

Experimenting with Machine Learning to Target In-App Messaging

Messaging at Spotify At Spotify, we use messaging to communicate with our listeners all over the world.

LinkedIn

Career stories: The power of an impactful mentor

Initially a Chicago-based data analyst, Jelanah had her heart set on a more meaningful career in frontend (UI) engineering.

Spotify

Experimenting at Scale, the Spotify Home Way

Introduction In the fast-paced world of streaming, personalization plays a vital role in enhancing user experiences.

Airbnb

Metis: Building Airbnb’s Next Generation Data Management Platform

LinkedIn

How LIquid Connects Everything So Our Members Can Do Anything

Imagine a tool that can store and connect all the information you need to make decisions and solve problems.

LinkedIn

How LinkedIn Adopted A GraphQL Architecture for Product Development

With the widespread adoption of Rest.

Spotify

What’s a “Listening Personality”?

We did a couple of new things in Wrapped this year, and one of these is a thing called Your Listening Personality.