Data-Infrastructure
Meta
Mon Mar 18 2024
Logarithm: A logging engine for AI training workflows and services
Systems and application logs play a key role in operations, observability, and debugging workflows at Meta.
Culture
Mon Feb 26 2024
How DotSlash makes executable deployment simpler
Andres Suarez and Michael Bolin, two software engineers at Meta, join Pascal Hartig (@passy) on the Meta Tech Podcast to discuss the ins and...
DevInfra
Tue Feb 20 2024
Aligning Velox and Apache Arrow: Towards composable data management
We’ve partnered with Voltron Data and the Arrow community to align and converge Apache Arrow with Velox, Meta’s open source execution engine...
Mon Feb 12 2024
Meta loves Python
By now you’re already aware that Python 3.
Tue Feb 06 2024
DotSlash: Simplified executable deployment
We’ve open sourced DotSlash, a tool that makes large executables available in source control with a negligible impact on repository size, th...
Thu Jan 18 2024
Lazy is the new fast: How Lazy Imports and Cinder accelerate machine learning at Meta
At Meta, the quest for faster model training has yielded an exciting milestone: the adoption of Lazy Imports and the Python Cinder runtime.
Tue Dec 19 2023
AI debugging at Meta with HawkEye
HawkEye is the powerful toolkit used internally at Meta for monitoring, observability, and debuggability of the end-to-end machine learning ...
Mon Oct 23 2023
5 Things you didn’t know about Buck2
Meta has a very large monorepo, with many different programming languages.
Thu Oct 05 2023
Meta contributes new features to Python 3.12
Python 3.
Thu Sep 07 2023
Arcadia: An end-to-end AI system performance simulator
We’re introducing Arcadia, Meta’s unified system that simulates the compute, memory, and network performance of AI training clusters.
Tue Sep 05 2023
What’s it like to write code at Meta?
Ever wonder what it’s like to write code at Meta’s scale? On the latest episode of the Meta Tech Podcast, Meta engineer Pascal Hartig (@pass...
Tue Aug 29 2023
Scheduling Jupyter Notebooks at Meta
At Meta, Bento is our internal Jupyter notebooks platform that is leveraged by many internal users.
Tue Aug 15 2023
Introducing Immortal Objects for Python
Instagram has introduced Immortal Objects – PEP-683 – to Python.
Mon Aug 07 2023
Fixit 2: Meta’s next-generation auto-fixing linter
Fixit is dead! Long live Fixit 2 – the latest version of our open-source auto-fixing linter.
Tue Jun 27 2023
Meta developer tools: Working at scale
Every day, thousands of developers at Meta are working in repositories with millions of files.