Data, Systems and Networking 9/27/2023

Scribe: Improving Reliability One 9 at a Time

Scribe is at the heart of data transport at Meta. From revenue critical data to important monitoring datasets flow through the system. This sets an extremely high reliability bar for the system. In this talk, we will take you through our journey of adding the 5th 9 to our SLAs. We’ll talk about how we […]
WATCH NOW

TRENDING POSTS

8/16/2023
How Meta’s Reels APIs is Empowering the Passion Economy
READ MORE
7/11/2023
ServiceRouter: Hyperscale Service Mesh at Meta
READ MORE

SORT

TOPIC
@SCALE SERIES
TYPE
DATE
TAGS
17 RESULTS
CLEAR ALL
Mobile, Video and Web 2/26/2024
Calling Relay Infrastructure at WhatsApp scale
Additional author: Woo Xie WhatsApp History and Scale Since the 2015 launch of WhatsApp’s calling feature, its calling relay infrastructure has been responsible for transmitting voice and video data between users with high reliability and low latency. Starting with one-to-one audio calling, followed by video calls and then group calls, usage of WhatsApp has grown […]
READ MORE
Mobile, Video and Web 2/26/2024
Real-time audio at Meta scale
Evolution of RTC audio Real-time communication (RTC) has come a long way, from desktop audio-only calls on wired networks to communications anytime, anywhere on cellular networks. At the same time, these advances have also introduced new challenges in terms of both network and device. Whereas at the start of the voice-over-internet protocol (VoIP) revolution, users […]
READ MORE
Data, Systems and Networking 12/19/2023
Q&A
WATCH NOW
Data, Systems and Networking 12/19/2023
MOBILE CONFIGURATION AT META
MobileConfig is Meta’s internal tool for the authoring and distributing configuration values across its many mobile apps and platforms, including Facebook, Instagram, and Oculus. Using MobileConfig, a developer can make a configuration change in minutes and have it distributed quickly and reliably to the billions of users who use our apps. Developers use the system […]
WATCH NOW
Data, Systems and Networking 12/19/2023
WAREHOUSE DISASTER RECOVERY
The presentation gives an overview of warehouse disaster recovery (DR). First, it provides context on company-wise DR efforts. Then it gives a quick overview of the data warehouse ecosystem and the importance of warehouse DR efforts. Later, it provides warehouse DR design and recent improvement for batch workload recovery.
WATCH NOW
Data, Systems and Networking 12/19/2023
CRANE: UBER’S NEXT-GEN INFRASTRUCTURE STACK
Uber has been on a multi-year journey to reimagine our infrastructure stack for a hybrid, multi-cloud world. The internal code name for this project is Crane. In this talk we’ll examine the original motivation behind Crane, requirements we needed to satisfy, and some key features of our implementation. Finally, we’ll wrap up with some forward-looking […]
WATCH NOW
Data, Systems and Networking 12/19/2023
Q&A
WATCH NOW
Data, Systems and Networking 12/19/2023
DATA LINEAGE UNLEASHED: NITRO’S APPROACH TO AUTOMATIC RESTATEMENTS
In an era where data is the lifeblood of enterprise innovation and decision-making, understanding and managing complex data lineage has emerged as a critical challenge for data engineers. This talk delves into the intricacies of data flows within modern businesses, where each layer’s changes ripple with profound implications for downstream processes. Addressing the pressing need […]
WATCH NOW
Data, Systems and Networking 12/19/2023
BRINGING DATA TO ASYNCHRONOUS COMPUTING AT SCALE
We delve into the details of bridging Asynchronous Computing with Meta’s data streams and the data warehouse, enabling a multitude of use cases at Meta. We share insights into technical challenges faced and the strategies employed to scale our data transport layer to handle trillions of daily jobs across thousands of heterogeneous tenants. The associated […]
WATCH NOW
Data, Systems and Networking 12/19/2023
LIVEGRAPH - SCALING REAL-TIME DATA ACCESS
LiveGraph is a GraphQL-like system that automatically keeps data up-to-date in the UI as changes happen to the underlying data. When it was first built, Figma had 500,000 weekly active users and only a single Postgres instance. Since then, we’ve scaled LiveGraph to keep up with the growth of Figma. Most recently we’ve built a […]
WATCH NOW
Data, Systems and Networking 12/19/2023
CONVEYOR: ONE-TOOL-FITS-ALL CONTINUOUS SOFTWARE DEPLOYMENT AT META
This presentation provides an overview of the design, implementation, usage scenarios and statistics of Conveyor, Meta’s Continuous Deployment system. Conveyor has been in production since 2015 and performs over 100,000 deployments per week across more than 10,000 services and millions of machines. We provide an analysis of real-world use cases and highlight advanced features necessary […]
WATCH NOW
Data, Systems and Networking 12/19/2023
Q&A
WATCH NOW

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy