Videos & Articles
Clear
Systems @Scale Spring 2021
Virtualizing Consensus in Delos for Rapid Upgrades and Happy Engineers
We will be hosting a talk about our work on Virtualizing Consensus In Delos For Rapid Upgrades And Happy Engineers during our virtual Systems @Scale event at 11am PT on Wednesday, March 17th, followed by a live Q&A session. Please ...
Systems @Scale Spring 2021
FlightTracker: Social graph consistency at scale
We will be hosting a talk about our work on FlightTracker: Social graph consistency at scale during our virtual Systems @Scale event at 11am PT on Wednesday, March 17th, followed by a live Q&A session. Please submit any questions ...
Systems @Scale Spring 2021
Workflows@Facebook: Powering developer productivity and automation at Facebook scale
We will be hosting a talk about our work on Workflows@Facebook: Powering Developer Productivity And Automation At Facebook Scale during our virtual Systems @Scale event at 11am PT on Wednesday, March 10th, followed by a live Q&A ...
Systems @Scale Spring 2021
Optimizing video storage via Semantic Replication
We will host a talk about our work on Optimizing video storage via Semantic Replication during our virtual Systems @Scale event at 11am PT on Wednesday, March 3rd, followed by a live Q&A session. Please submit any questions you may ...
Performance @Scale NY
Performance @Scale 2020: Optimizing the Instagram Web Tier
Instagram is one of the largest Python deployments which supports billions of people using the service. As the system and features keep growing, so has our compute footprint. This was even more evident this year when global lockdowns ...
Performance @Scale NY
Performance @Scale 2020: Improving UX with resource prioritization
With today’s complex web content, ordering the requests for resources can have a dramatic impact on the resulting user experience. Patrick will explore what the impact of the ordering can have, discuss practical solutions to ...
Performance @Scale NY
Performance @Scale 2020: Scaling machine learning on graphs
Networks (graphs) of people’s social and content interactions are a rich source of data for machine learning algorithms. Traditional machine learning algorithms do not naturally take graph-structured data as input, so unsupervised ...
Performance @Scale NY
Performance @Scale 2020: Understanding emotion for happy users
In this talk we will look at how to collect, analyze, and act on a few metrics that tell us more about how our user feels when using the site. We can trend how these metrics change over a user’s browsing experience, and we can improve ...
Performance @Scale NY
Performance @Scale 2020: Facebook’s developer infrastructure
In our first talk of the conference you’ll hear how Facebook is scaling its performance efforts across many apps that are growing and evolving rapidly. What are the newest directions Facebook is exploring to make apps fast and keep ...
Keeping the Lights On @Scale
Keeping the Lights on @Scale 2020: Panel discussion
This panel discussion will explore how our global engineering team immediately came together as one at the start of the pandemic. Through it all, Facebook wasn’t just “keeping the lights on.” Our team was ushering in the future of ...
Keeping the Lights On @Scale
Keeping the Lights on @Scale 2020: Remote Work @Scale
On March 6, Facebook closed its global offices and employees began working from home. It was the start of the largest remote work experiment ever created. This presentation will provide an inside look at how we enabled our engineers to ...
AI @Scale
AI @Scale: Flyte: Making MLOps and DataOps a reality
Flyte is the backbone for large-scale Machine Learning and Data Processing (ETL) pipelines at Lyft. It is used across business critical applications ranging from ETA, Pricing, Mapping, Autonomous, etc. At its core it is a Kubernetes ...
AI @Scale
AI @Scale 2020: Azure Cognitive Services @Scale
Azure Cognitive Services sits at the core of many essential products and services at Microsoft for internal and external workloads. Anand’s talk describes the hardware and software infrastructure that supports Ai services at global ...
AI @Scale
AI @Scale 2020: Mastercook: Large scale concurrent model development in ads ranking
We will discuss a novel model development process and tools we introduced to ads ranking machine learning teams, where a single model can be concurrently developed by dozens of engineers, whose changes to the model are centralized ...
AI @Scale
AI @Scale 2020: Large Scale Machine Learning Using SQL in BigQuery
Google BigQuery is a petabyte-scale serverless cloud data warehouse that enables scalable machine learning using SQL. In this talk, we take a look at how enabling data analysts and other SQL users to perform machine learning tasks can ...
AI @Scale
AI @Scale 2020: Netflix’s Human-Centric Approach to ML Infrastructure
Netflix’s unique culture affords it’s data scientists extraordinary freedom of choice in ML tools and libraries. At the same time, they are responsible for building, deploying, and operating complex ML workflows ...
AI @Scale
AI @Scale 2020: F3: Next-generation Feature Framework at Facebook
We will discuss the next generation feature framework in development at Facebook. This new framework enables efficient experimentation in building machine learning features to semantically model behaviors and intent of users, and ...
AI @Scale
AI @Scale 2020: High Performance Observability Across the ML Lifecycle
The scale and breadth of ML applications have increased dramatically thanks to scalable model-training and serving technologies. Builders of enterprise ML systems often have to contend with both real-time inference and massive amounts ...
Systems @Scale Remote Edition — Summer 2020
Systems @Scale Summer 2020 Q&A
As part of the Systems @Scale event, engineers participated in a series of live Q&As about the engineering work presented in the technical talks. We’ve collected those questions and the engineers’ responses below. Asynchronous ...
Networking @Scale
Networking @Scale Boston 2019 Recap
Networking solutions are important for building applications and services that serve billions of people around the world. At this year’s Networking @Scale conference in Boston, attendees gathered to hear engineers from Akamai, Boston ...
The @Scale Conference 2019
2019 @Scale Conference recap
The @Scale Conference is an invitation-only technical event for engineers who work on large-scale platforms and technologies. This year’s event took place on October 16 at the San Jose Convention Center, where more than 1,300 attendees ...
Video @Scale 2019
Video @Scale 2019 recap
The development of large-scale video systems includes complex, unprecedented engineering challenges. At Video @Scale 2019, engineers gathered in San Francisco for a day of technical talks focused on delivering video at scale. Speakers ...
The @Scale Conference 2019
@Scale 2019: Streaming, flexible log parsing with real-time applications
Logs from cybersecurity appliances are numerous, generated from heterogeneous sources, and frequently victim to poor hygiene and malformed content. Relying on an already understaffed human workforce to constantly write new parsers, ...
The @Scale Conference 2019
@Scale 2019: Automated detection of blockchain network events
Ever wondered what goes on behind the scenes to keep user assets safe in the notoriously dangerous field of cryptocurrency custodianship? Turns out you can model cryptocurrency protocols after existing communications networks, then ...
The @Scale Conference 2019
@Scale 2019: The call is coming from inside the house: Lessons in securing internal apps
Locking down internal apps presents unique and frustrating challenges for appsec teams. Your organization may have dozens if not hundreds of sensitive internal tools, dashboards, and control panels, running on heterogenous technical ...
The @Scale Conference 2019
@Scale 2019: Enforcing encryption at scale
Facebook runs a global infrastructure that supports thousands of services, with many new ones spinning up daily. Protecting network traffic is taken very seriously, and engineers must have a sustainable way to enforce security policies ...
The @Scale Conference 2019
@Scale 2019: Securing SSH traffic to 190+ data centers
Cloudflare maintains thousands of servers in more than 190 points of presence that need to be accessed from multiple offices. Samuel and Evan discuss their experiences depending on a private network and SSH keys to securely connect to ...
The @Scale Conference 2019
@Scale 2019: Leveraging the type system to write secure applications
Shannon discusses ways to extend the type system to eliminate entire classes of security vulnerabilities at scale. Application security remains a long-term and high-stakes challenge for most projects that interact with external users. ...
The @Scale Conference 2019
@Scale 2019: Fairness and privacy in AI/ML systems
With the ongoing explosive growth of AI/ML models and systems, Krishnaram explores some of the ethical, legal, and technical challenges that researchers and practitioners alike encounter. He discusses the need for adopting a fairness ...
The @Scale Conference 2019
Fireside Chat on Privacy
Vladimir Fedorov sits down with Lea Kissner to dig deeper into the issues of privacy and respect Lea touched on in her keynote.
The @Scale Conference 2019
@Scale 2019: Data Transfer Project – Expanding Data Portability at Scale
The Data Transfer Project was launched in 2018 to create an open-source, service-to-service data portability platform so that all individuals across the web could easily move their data between online service providers whenever they ...
The @Scale Conference 2019
@Scale 2019: DNS privacy at scale: Lessons and challenges
It’s no secret that the use of the domain name system reveals a lot of information about what people do online. The use of traditional unencrypted DNS protocols reveals this information to third parties on the network, introducing ...
The @Scale Conference 2019
Firefox Origin Telemetry with Prio
Measuring browsing behavior by site origin can provide actionable insights into the broader web ecosystem in areas such as blocklist efficacy and web compatibility. However, an individual’s browsing history contains deeply personal ...
The @Scale Conference 2019
@Scale 2019: Fighting fraud anonymously
Logging is essential to running a service or an app. But every app faces a dilemma: The more data is logged, the more we understand the problems of users, but the less privacy they have. One way to add privacy is to report events ...
The @Scale Conference 2019
@Scale 2019: Pushing the state of the art in AI with PyTorch
Joe shares how PyTorch is being used to help accelerate the path from novel research to large-scale production deployment in computer vision, natural language processing, and machine translation at Facebook. He further explores the ...
The @Scale Conference 2019
@Scale 2019: Natural language processing for production-level conversational interfaces
Conversational applications often are overhyped and underperform. There’s been significant progress in natural language understanding in academia and a huge growing market for conversational technologies, but NLU performance ...
The @Scale Conference 2019
@Scale 2019: Cross-product optimization
Artificial intelligence powers every product experience at LinkedIn. Whether ranking the member’s feed or recommending new jobs, AI is used to fulfill LinkedIn’s mission of connecting the world’s professionals to make them more ...
The @Scale Conference 2019
@Scale 2019: Multinode: Natural language understanding at scale
This session includes an in-depth look at the world of multinode training for complex NLU models such as BERT. Sharan describes the challenges of tuning for speed and accuracy at the scale needed to bring training times down from weeks ...
The @Scale Conference 2019
@Scale 2019: Reading text from visual content at scale
Vinaya presents multiple innovations across modeling, training infrastructure, deployment infrastructure, and efficiency measures Facebook has made to build its state-of-the-art OCR system running at Facebook scale. There are billions ...
The @Scale Conference 2019
@Scale 2019: Unique challenges and opportunities for self-supervised learning in autonomous driving
Autonomous vehicles generate a lot of raw (unlabeled) data every minute. But only a small fraction of that data can be labeled manually. Ashesh focuses on how we leverage unlabeled data for tasks on perception and prediction in a ...
The @Scale Conference 2019
@Scale 2019: Disaggregated Graph Database with Rich Read Semantics
Access to the social graph is a mission critical workload for Facebook. Supporting a graph data model is inherently difficult because the underlying system has to be capable of efficiently supporting the combinatoric explosion of ...
The @Scale Conference 2019
@Scale 2019: Kafka @Scale: Confluent’s Journey Bringing Event Streaming to the Cloud
As streaming platforms become central to data strategies, companies both small and large are re-thinking their architecture with real-time context at the forefront. What was once a ‘batch’ mindset is quickly being replaced with stream ...
The @Scale Conference 2019
@Scale 2019: Amazon DynamoDB: Fast and flexible NoSQL database service for any scale
Amazon DynamoDB is a hyperscale, NoSQL database designed for internet-scale applications, such as serverless web apps, mobile backends, and microservices. DynamoDB provides developers with the security, availability, durability, ...
The @Scale Conference 2019
@Scale 2019: Architecture of a Highly Available Sequential Data Platform
LogDevice is a unified, high-throughput, low-latency platform for handling a variety of data streaming and logging needs. Specifically this talk with be diving into the architectural details and variants of Paxos used in LogDevice to ...
The @Scale Conference 2019
@Scale 2019: 6 Technical Challenges Developing a Distributed SQL Database
Developing YugaByte DB was but not without its fair share of technical challenges. There were times when we had to go back to the drawing board and even sift through academic research to find a better solution than what we had at hand. ...
The @Scale Conference 2019
@Scale 2019: Zanzibar: Google’s Consistent, Global Authorization System
Determining whether online users are authorized to access digital objects is central to preserving privacy. This talk presents the design, implementation, and deployment of Zanzibar, a global system for storing and evaluating access ...
The @Scale Conference 2019
@Scale 2019 Keynote: Engineering For Respect: Building Systems For The World We Live In
When we build systems, we want to build great systems. Great products and systems are respectful, treating both their users and other affected parties with care, concern, and consideration for their needs and feelings. Doing this at ...
The @Scale Conference 2019
@Scale 2019 Keynote: AI — The Next Big Scaling Frontier
In the past several years, Facebook has made significant progress across computer vision, language understanding, speech recognition, and personalization. But this rapid growth brings with it serious scaling challenges. In his keynote, ...