infrastructure
Pinterest
Mon Nov 18 2024
Change Data Capture at Pinterest
Hardware
Dropbox
Wed Oct 23 2024
What’s new with Robinhood, our in-house load balancing service
Infrastructure
Cloudflare
Tue Oct 22 2024
Is this thing on? Using OpenBMC and ACPI power states for reliable server boot
Cloudflare’s global fleet benefits from being managed by open source firmware for the Baseboard Management Controller (BMC), OpenBMC.
Kubernetes
Tue Oct 08 2024
Leveraging Kubernetes virtual machines at Cloudflare with KubeVirt
The Kubernetes team runs several multi-tenant clusters across Cloudflare’s core data centers.
data
Airbnb
Tue Sep 10 2024
Riverbed Data Hydration — Part 1
time-series-database
Mon Sep 09 2024
Improving Efficiency Of Goku Time Series Database at Pinterest (Part — 3)
machine-learning
Thu Aug 08 2024
NEP: Notification System and Relevance
engineering
Wed Jul 31 2024
Delivering Faster Analytics at Pinterest
kubernetes
Apache Flink® on Kubernetes
Canva
Tue Jul 30 2024
Faster continuous integration builds at Canva
How we improved our continuous integration build times from hours to less than 30 minutes.
Metadata
Thu Jul 25 2024
Meet Chrono, our scalable, consistent, metadata caching solution
front-end-development
Tue Jul 23 2024
How Airbnb Smoothly Upgrades React
Data
Spotify
Tue Apr 02 2024
Data Platform Explained
As engineers working at Spotify, we frequently find ourselves explaining our robust data platform to fellow professionals who are contemplat...
platform-as-a-runtime
Wix
Wed Mar 20 2024
Discover the Future of Infrastructure at Our Upcoming Meetup!
pinterest
Thu Feb 22 2024
Unlocking AI Assisted Development Safely: From Idea to GA
Fri Jan 26 2024
Migrating Policy Delivery Engines with (almost) Nobody Knowing
LinkedIn
Tue Jan 16 2024
The Evolution of Enforcing our Professional Community Policies at Scale
LinkedIn is always working hard to make sure that its platform is a safe and trusted place for its members.
database
Thu Jan 04 2024
Building Pinterest’s new wide column database using RocksDB
Wed Dec 20 2023
Building Trust and Combating Abuse On Our Platform
At LinkedIn, trust is the cornerstone for building meaningful connections and professional relationships.
Tue Dec 19 2023
Deployment of Exabyte-Backed Big Data Components
Co-authors: Arjun Mohnot, Jenchang Ho, Anthony Quigley, Xing Lin, Anil Alluri, Michael Kuchenbecker LinkedIn operates one of the world’s lar...
Engineering
GitHub
Thu Dec 07 2023
Upgrading GitHub.com to MySQL 8.0
GitHub uses MySQL to store vast amounts of relational data.
Tue Nov 28 2023
A Glimpse into the Redesigned Goku-Ingestor vNext at Pinterest
Wed Nov 22 2023
Improving Efficiency Of Goku Time Series Database at Pinterest (Part — 1)
Skills
Mon Nov 20 2023
How LinkedIn Built the Engineering Infrastructure to Ignite Professional Knowledge Sharing
Co-Authors: Shweta Patira, Ankan Saha, Yilin Li, and Manas Somaiya Earlier this year, we launched Collaborative Articles with the vision of ...
Tue Nov 14 2023
From AI to sustainability, why our latest data centers use 400G networking
Tue Nov 07 2023
Running Unified PubSub Client in Production at Pinterest
Tue Oct 31 2023
PinCompute: A Kubernetes Backed General Purpose Compute Platform for Pinterest
Developer-Tools
Tue Oct 17 2023
Switching Build Systems, Seamlessly
At Spotify, we have experimented with the Bazel build system since 2017.
Fri Sep 29 2023
Lessons from debugging a tricky direct memory leak
Tue Sep 12 2023
Last Mile Data Processing with Ray
Thu Sep 07 2023
Solving Espresso’s scalability and performance challenges to support our member base
Espresso is the database that we designed to power our member profiles, feed, recommendations, and hundreds of other Linkedin applications t...
Tue Sep 05 2023
MLEnv: Standardizing ML at Pinterest Under One ML Engine to Accelerate Innovation
Wed Aug 30 2023
Open Sourcing iris-message-processor
One measure of a successful network is uptime - providing consistent, reliable service for members and customers.
Thu Jul 27 2023
Costwiz: Saving cost for LinkedIn enterprise on Azure
Authors: Deven Walia, Vivek Subramaniam, Simon Desowza, and Karthik Subramanian Cloud services have completely changed the way we approach i...
distributed-systems
Tue Jul 25 2023
Riverbed: Optimizing Data Access at Airbnb’s Scale
Securely Scaling Big Data Access Controls At Pinterest
Wed Jul 19 2023
Taking Charge of Tables: Introducing OpenHouse for Big Data Management
Co-Authors: Sumedh Sakdeo, Lei Sun, Sushant Raikar, Stanislav Pak, and Abhishek Nath Introduction At LinkedIn, we build and operate an open ...
Tue Jul 18 2023
Analyzing Time Series for Pinterest Observability
sre
Tue Jul 11 2023
Tuning Flink Clusters for Stability and Efficiency
Thu Jun 22 2023
Analyzing Volatile Memory on a Google Kubernetes Engine Node
TL:DR At Spotify, we run containerized workloads in production across our entire organization in five regions where our main production work...
Backend
Mon Jun 19 2023
Relational Database Migration with AWS Database Migration Service (DMS)
data-center
Tue Jun 13 2023
How the data center site selection process works at Dropbox
Economic-Graph-Research
Fri Jun 02 2023
From the Economic Graph to Economic Insights: Building the Infrastructure for Delivering Labor Market Insights from LinkedIn Data
Authors: Dr.
Tue May 23 2023
Pacer: Pinterest’s New Generation of Asynchronous Computing Platform
http-streaming
Wed May 17 2023
Improving Performance with HTTP Streaming
Mon May 15 2023
Fleet Management at Spotify (Part 3): Fleet-wide Refactoring
This is part 3 in our series on Fleet Management at Spotify and how we manage our software at scale.
Thu May 11 2023
Journey Platform: A low-code tool for creating interactive user workflows
Metal as a Service (MaaS): DIY server-management at scale
Guaranteeing that our servers are continually upgraded to secure and vetted operating systems is one major step that we take to ensure our m...
Amazon-S3
Thu May 04 2023
How Canva saves millions annually in Amazon S3 costs
Understanding our data and usage patterns was the real key.
Wed May 03 2023
Fleet Management at Spotify (Part 2): The Path to Declarative Infrastructure
This is part 2 in our series on Fleet Management at Spotify and how we manage our software at scale.
Tue May 02 2023
Large-scale User Sequences at Pinterest
scale
How LIquid Connects Everything So Our Members Can Do Anything
Imagine a tool that can store and connect all the information you need to make decisions and solve problems.
SaltStack
Tue Apr 18 2023
Scaling Salt for Remote Execution to support LinkedIn Infra growth
At LinkedIn, site engineers like to automate operational tasks at various infrastructure layers to minimize manual interventions, which can ...
single-page-applications
Tue Apr 11 2023
How Edison is helping us build a faster, more powerful Dropbox on the web
Thu Mar 23 2023
Improving Istio Propagation Delay
Wed Mar 08 2023
After four years of SMR storage, here's what we love?and what comes next
Thu Feb 23 2023
Pinterest is now on HTTP/3
validation
Tue Feb 07 2023
Balancing quality and coverage with our data validation framework
Wed Feb 01 2023
Unleashing ML Innovation at Spotify with Ray
Introduction As the field of machine learning (ML) continues to evolve and its impact on society and various aspects of our lives grows, it ...
Thu Jan 26 2023
Unifying Messaging Experiences across LinkedIn
Co-authors: Michele Ursino and Joe Xue Introduction At LinkedIn, we believe that an opportunity can arise from just one conversation, so hav...
Thu Dec 15 2022
Accelerating Code Delivery By 97% With Yarn Workspaces
As teams and applications experience growth, it’s critical to adopt architectures that optimize for clear code ownership, build isolation, a...
Tue Dec 13 2022
Ocelot: Scaling observational causal inference at LinkedIn
Co-authors: Kenneth Tay and Xiaofeng Wang At Linkedin, we constantly evaluate the value our products and services deliver, so that we can pr...
Tue Nov 15 2022
Strategies and Tools for Performing Migrations on Platform
Needing to deliver faster and more reliably while managing a growing number of contributors and a more complex codebase seems like the fate ...
Thu Nov 03 2022
Future-proofing our metadata stack with Panda, a scalable key-value store
Quality-Assurance
Mon Aug 29 2022
How We Used Data to Optimize Our Quality Assistance Model
From firefighting chaos to problem solving zen.