Videos & Articles
Clear
Video @Scale 2021
The Importance of Audio Today
Live Panel – “The Importance of Audio Today”. Recently, Audio has been front and center with the emergence of new audio-only products and experiences and many new audio-focused investments to enhance video viewing. ...
Video @Scale 2021
Highly-Efficient SVT-AV1-based Solutions for VOD Applications
This presentation will highlight the latest improvements of the VOD-targeted high-latency Constant Rate Factor (CRF) and Variable Bit Rate (VBR) modes of the SVT-AV1 encoder. It will first present the latest SVT-AV1 cycles-quality ...
Video @Scale 2021
Scaling Your Encoding Backend Using Eve
In this talk, we will discuss the current state in terms of bitrate/quality and complexity of Two Orioles’ Eve video encoder for the VP9 & AV1 video codecs. VP9 provides meaningful quality improvements over H.264 with a mature ...
Video @Scale 2021
Video Quality Assessment of User Generated Contents
Video quality of User Generated Content (UGC) is extremely difficult to wrangle with due to their high diversity of contents and quality. They bring new challenges to how we traditionally measured and assessed video quality. Most ...
Video @Scale 2021
Measuring Video Quality Using AVQT
AVQT, short for Advanced Video Quality Tool, is a macOS based command line tool which estimates perceptual video quality of compressed videos that might contain video coding and scaling artifacts. Utilizing the AVFoundation framework, ...
Video @Scale 2021
Optimizing Storage Efficiency for FB Video Processing
Like the rest of the video world, Facebook Video has significantly grown year to year. While we celebrate the growth rate, we are also concerned about the resources consumption to support the growth, which became worse during COVID. ...
Video @Scale 2021
ASIC-RDX and Compute-Compression Efficiency Optimization for UGC Video Processing
Facebook and user-generated content (UGC) platforms encode videos at “billion-scale” and deliver them worldwide to a variety of devices (Mobile/Laptop/TV) across different networks. The popularity of UGC videos can vary widely ranging ...
Video @Scale 2021
Behind the Curtains: A/B Tests in Video Land
A/B testing on video isn’t just about tweaking recommendations or picking the perfect thumbnail. Every aspect of video benefits from rapid experimentation including the infrastructure – streaming algorithms, codecs, bitrates, caching ...
Video @Scale 2021
Media Provenance as a Prevention for Malicious Synthetic Media
Malicious synthetic media – both deepfakes and cheapfakes – are rising in prevalence and importance. End users are rapidly losing trust in media, and their ability to tell authentic media from inauthentic has greatly diminished. This ...
Video @Scale 2021
Smart Crop and Smart Preview via Video Understanding
Understanding video content has been a focus for video-sharing platforms. It is one of the most important driving forces for the growth in distribution, discovery, user experience and monetization. Instream video understanding is the ...
Video @Scale 2021
Highly Available Live Encoding Using Go and Kubernetes
Two years ago, iStreamPlanet set out to build a cloud-native software transcoder with the reliability and feature set to support some of the highest profile live channels and events in the world. Some of our goals included: 4+ 9’s of ...
Video @Scale 2021
Performance of Low-Latency DASH/CMAF and Low-Latency HLS Systems
Reducing end-to-end streaming latency is critical for HTTP-based live video streaming. There are currently two new technologies in this domain: Low-Latency HTTP Live Streaming (LL-HLS) and Low-Latency Dynamic Adaptive Streaming over ...
Video @Scale 2021
Measuring the Reliability of Live Video Infrastructure
Serving Live Videos with high reliability is challenging, not only from the perspective of deploying improvements on top of a distributed system but also from the perspective of defining correct measurements to capture reliability gaps ...
Video @Scale 2021
Keynote
Hear from Paresh Rajwat, the Vice President and Head of Product for Facebook Audio, Video, and Music.
Systems @Scale Fall 2021
Week 3 Live Q&A – Systems @Scale Fall 2021 Edition
Week 3 Live Q&A – Systems @Scale Fall 2021 Edition with speakers discussing Challenges@Scale
Systems @Scale Fall 2021
Scaling Back-End Deployment @ Facebook
We present how Facebook’s unified Continuous Deployment (CD) system, Conveyor, powers safe and flexible service deployment across all services at Facebook. Conveyor enables services owners to build highly customized deployment ...
Systems @Scale Fall 2021
Lessons from Building a Large-scale, Multi-cloud Data Platform at Databricks
The cloud is becoming one of the most attractive ways for enterprises to store, analyze, and get value from their data, but building and operating a data platform in the cloud has a number of new challenges compared to traditional ...
Systems @Scale Fall 2021
Making Distributed Priority Queue Disaster Ready
Facebook Ordered Queue Service (FOQS) is a distributed priority queue service that powers hundreds of services and products across the Facebook stack. Facebook users have come to rely on its services to remain connected to their ...
Systems @Scale Fall 2021
Scaling Apache Kafka in the Cloud
Confluent Inc provides cloud based data stream platforms based on Apache Kafka. Running an open source product like Kafka on the public cloud offerings of Amazon, Google, and Microsoft offers an interesting array of challenges. This ...
Systems @Scale Fall 2021
Week 2 Live Q&A – Systems @Scale Fall 2021 Edition
Week 2 Live Q&A – Systems @Scale Fall 2021 Edition with speakers discussing Reliability & Testing
Systems @Scale Fall 2021
Power Loss Siren: Making Facebook Resilient to Power Outages
Power outages cause the majority of unplanned server downtime in Facebook data centers. During a power outage, thousands of servers can go offline simultaneously for several hours, which can lead to service degradations. At Facebook, ...
Systems @Scale Fall 2021
Scaling Testing at a Startup: Integration Testing GraphQL Services with Jest
BigSpring is a mobile first platform for lifelong skilling with measurable ROI. We use GraphQL to power our services. We would love to talk about how we use Jest to integration test our resolvers and other business logic built in our ...
Systems @Scale Fall 2021
Automatic Testing for Services at Scale
Developing at speed and scale across Facebook’s many services requires testing frameworks that help developers iterate on features quickly and with minimal friction, while helping to catch bugs early. Learn why we’ve built our own ...
Systems @Scale Fall 2021
Blaming in a Blameless World
Attribution of reliability in a microservice architecture can be solved, and has been solved, in very different ways due to how services are cataloged across the industry. Our hypothesis at Lyft was that service catalogs can become ...
Systems @Scale Fall 2021
Amazon Redshift Reinvented
In 2013, eight years ago, Amazon Web Services revolutionized the data warehousing industry by launching Amazon Redshift, the first fully managed, petabyte-scale cloud data warehouse solution. Amazon Redshift made it simple and ...
Systems @Scale Fall 2021
Week 1 Live Q&A – Systems @Scale Fall 2021 Edition
Week 1 Live Q&A – Systems @Scale Fall 2021 Edition with speakers discussing Capacity & Efficiency
Systems @Scale Fall 2021
End-2-End Resource Accounting Leveraging Distributed Tracing
Transitive Resource Accounting (TRA) is a system that builds on top of Facebook’s distributed traces platform, Canopy, with the goal of capturing end-2-end request cost metrics and attributing them back to the originating caller. This ...
Systems @Scale Fall 2021
Log Events @ Twitter: Challenges of Handling Billions of Events per Minute
At Twitter, hundreds of thousands of microservices emit important events triggered by user interactions on the platform. The Data Platform team has the requirement to aggregate these events by service type and generate consolidated ...
Systems @Scale Fall 2021
RAS: A Resource Allowance System for Perpetual Region-wide Resource Allocation
Facebook is undergoing a massive design shift in capacity management and service placement to scale the efficiency of our datacenter resources. At the core of this shift is the Resource Allowance System (RAS) that continuously ...
Systems @Scale Summer 2021
Week 4 Live Q&A – Systems @Scale Summer 2021 Edition
Systems @Scale, Summer – Week 4 Q&A with speakers discussing Performance
Systems @Scale Summer 2021
Resource Guarantees in a Multi-Tenant Infrastructure
The Facebook cloud supports a variety of workloads including those which are CPU intensive, memory bound, I/O bound, latency sensitive, or a combination of these, on hardware that ranges from smaller single socket servers to load ...
Systems @Scale Summer 2021
Platform Agnostic Observability System for AI Accelerators
Application specific hardware platforms play a crucial role in meeting the growing latency and compute demands of workloads like deep learning, content understanding and video encoding. However, it is challenging to operate these ...
Systems @Scale Summer 2021
Performance Wins with BPF: Getting Started
BPF (eBPF) tracing is the superpower that can analyze everything, helping you find performance wins, troubleshoot software, and more. But with many different front-ends and languages, and years of evolution, finding the right starting ...
Systems @Scale Summer 2021
Week 3 Live Q&A – Systems @Scale Summer 2021 Edition
Systems @Scale, Summer – Week 3 Live Q&A with speakers discussing Scalability
Systems @Scale Summer 2021
What is Behind Alibaba’s Double 11 Shopping Festival – The Architecture Evolution of Flink Stream-Batch Unification UNIFICATION
In this talk, we share some of the most exciting achievements of Flink at Alibaba in recent years, including two main topics: one is the architecture evolution of stream-batch unification; the other is the recent efforts to improve ...
Systems @Scale Summer 2021
Consolidating Storage Backend at Scale with Tectonic Filesystem
Tectonic is Facebook’s exabyte-scale, datacenter-wide distributed filesystem. Prior to Tectonic, Facebook’s storage infrastructure consisted of a constellation of smaller, specialized storage systems. Blob storage was spread across ...
Systems @Scale Summer 2021
ARKDB: The Key-Value Engine for Alibaba Cloud Storage Services
Alibaba Cloud offers a comprehensive set of storage services, including Object Storage Service (OSS), File Storage Service (NAS) and NoSQL Tablestore with high durability, high availability, high scalability and strong consistency. All ...
Systems @Scale Summer 2021
Week 2 Live Q&A – Systems @Scale Summer 2021 Edition
Systems @Scale, Summer – Week 2 Live Q&A with speakers discussing Cluster Management, Capacity, and Provisioning @Scale
Systems @Scale Summer 2021
Dynamic Leasing of Spare Capacity to Improve Fleet Utilization with Optimus
Optimus, our spare capacity leasing system, coordinates capacity allocations on millions of machines to improve global capacity utilization and meet fast growing business needs. Within Facebook’s infrastructure, spares are ...
Systems @Scale Summer 2021
Morcor – Co-location of Mixed Workloads at Uber
Uber infrastructure broadly supports 3 kinds of workloads: stateless microservices, big data (batch) and stateful, each running on its own hardware silo. Morcor aims to reduce the cost of infrastructure through co-location of stateless ...
Systems @Scale Summer 2021
Managing a Million Kubernetes Clusters
Azure Kubernetes Service (AKS) manages Kubernetes clusters on behalf of customers. AKS stays agnostic to the customer workload and manages the accessibility, performance, and reliability of these clusters without requiring full ...
Systems @Scale Summer 2021
Defining Service Level Objectives for Exposure Notifications Servers
This session will share the real-world lessons from reliability engineering work on the Exposure Notifications Server – A project from Google and Apple in an effort to slow the spread of COVID-19. The work from Google SRE ...
Systems @Scale Summer 2021
Better Resilience Through Self Tuning
William previously worked at Netflix, and this presentation will highlight some of the strategies he used while working there. He has the permission of Netflix to discuss them at this conference. As companies grow and the number of ...
Systems @Scale Summer 2021
Avoiding Overload in Distributed Systems
At AWS, we build systems using a variety of complementary strategies for maintaining predictable, consistent performance in the face of overload. In this talk, we describe techniques such as implementing layers of protection, ...
Systems @Scale Summer 2021
Live Traffic Load-Testing-Measuring and Validating Capacity at Facebook
Facebook is made up of hundreds of heterogeneous services in geographically distributed data center regions. To reliably run, providing a sufficient amount of capacity for all sub-systems and services is crucial. However, understanding ...
Systems @Scale Summer 2021
Week 1 Live Q&A – Systems @Scale Summer 2021 Edition
Systems @Scale, Summer – Week 1 Live Q&A with speakers discussing Reliability.
Systems @Scale Spring 2021
Virtualizing Consensus in Delos for Rapid Upgrades and Happy Engineers
We will be hosting a talk about our work on Virtualizing Consensus In Delos For Rapid Upgrades And Happy Engineers during our virtual Systems @Scale event at 11am PT on Wednesday, March 17th, followed by a live Q&A session. Please ...
Systems @Scale Spring 2021
FlightTracker: Social graph consistency at scale
We will be hosting a talk about our work on FlightTracker: Social graph consistency at scale during our virtual Systems @Scale event at 11am PT on Wednesday, March 17th, followed by a live Q&A session. Please submit any questions ...
Systems @Scale Spring 2021
Systems @Scale Spring 2021: Week 3
Welcome to the third week of Systems@Scale – Spring 2021, Virtual Edition – featuring recorded sessions & Live Q&As with Maxim Fateev, Girish Joshi, and Dan Shiovitz.
Systems @Scale Spring 2021
Workflows@Facebook: Powering developer productivity and automation at Facebook scale
We will be hosting a talk about our work on Workflows@Facebook: Powering Developer Productivity And Automation At Facebook Scale during our virtual Systems @Scale event at 11am PT on Wednesday, March 10th, followed by a live Q&A ...
Systems @Scale Spring 2021
Week 2 Live Q&A – Systems @Scale Spring 2021 Edition
Welcome to the second week of Systems@Scale – Spring 2021, Virtual Edition – featuring recorded sessions & Live Q&As with Chidambaram Muthu, Dan Danaila, and Sazzala Reddy.
Systems @Scale Spring 2021
Optimizing video storage via Semantic Replication
We will host a talk about our work on Optimizing video storage via Semantic Replication during our virtual Systems @Scale event at 11am PT on Wednesday, March 3rd, followed by a live Q&A session. Please submit any questions you may ...
Systems @Scale Spring 2021
Week 1 Live Q&A – Systems @Scale Spring 2021 Edition
Welcome to the first week of Systems@Scale – Spring 2021, Virtual Edition – featuring recorded sessions and Live Q&A sessions with Akshay Nanavati, Niharika Devanathan, and Gerhard Lazu.
Performance @Scale NY
Performance @Scale 2020: Optimizing the Instagram Web Tier
Instagram is one of the largest Python deployments which supports billions of people using the service. As the system and features keep growing, so has our compute footprint. This was even more evident this year when global lockdowns ...
Performance @Scale NY
Performance @Scale 2020: Improving UX with resource prioritization
With today’s complex web content, ordering the requests for resources can have a dramatic impact on the resulting user experience. Patrick will explore what the impact of the ordering can have, discuss practical solutions to ...
Performance @Scale NY
Performance @Scale 2020: Scaling machine learning on graphs
Networks (graphs) of people’s social and content interactions are a rich source of data for machine learning algorithms. Traditional machine learning algorithms do not naturally take graph-structured data as input, so unsupervised ...
Performance @Scale NY
Performance @Scale 2020: Understanding emotion for happy users
In this talk we will look at how to collect, analyze, and act on a few metrics that tell us more about how our user feels when using the site. We can trend how these metrics change over a user’s browsing experience, and we can improve ...
Performance @Scale NY
Performance @Scale 2020: Facebook’s developer infrastructure
In our first talk of the conference you’ll hear how Facebook is scaling its performance efforts across many apps that are growing and evolving rapidly. What are the newest directions Facebook is exploring to make apps fast and keep ...
Keeping the Lights On @Scale
Keeping the Lights on @Scale 2020: Panel discussion
This panel discussion will explore how our global engineering team immediately came together as one at the start of the pandemic. Through it all, Facebook wasn’t just “keeping the lights on.” Our team was ushering in the future of ...
Keeping the Lights On @Scale
Keeping the Lights on @Scale 2020: Remote Work @Scale
On March 6, Facebook closed its global offices and employees began working from home. It was the start of the largest remote work experiment ever created. This presentation will provide an inside look at how we enabled our engineers to ...
AI @Scale
AI @Scale: Flyte: Making MLOps and DataOps a reality
Flyte is the backbone for large-scale Machine Learning and Data Processing (ETL) pipelines at Lyft. It is used across business critical applications ranging from ETA, Pricing, Mapping, Autonomous, etc. At its core it is a Kubernetes ...
AI @Scale
AI @Scale 2020: Azure Cognitive Services @Scale
Azure Cognitive Services sits at the core of many essential products and services at Microsoft for internal and external workloads. Anand’s talk describes the hardware and software infrastructure that supports Ai services at global ...
AI @Scale
AI @Scale 2020: Mastercook: Large scale concurrent model development in ads ranking
We will discuss a novel model development process and tools we introduced to ads ranking machine learning teams, where a single model can be concurrently developed by dozens of engineers, whose changes to the model are centralized ...
AI @Scale
AI @Scale 2020: Large Scale Machine Learning Using SQL in BigQuery
Google BigQuery is a petabyte-scale serverless cloud data warehouse that enables scalable machine learning using SQL. In this talk, we take a look at how enabling data analysts and other SQL users to perform machine learning tasks can ...
AI @Scale
AI @Scale 2020: Netflix’s Human-Centric Approach to ML Infrastructure
Netflix’s unique culture affords it’s data scientists extraordinary freedom of choice in ML tools and libraries. At the same time, they are responsible for building, deploying, and operating complex ML workflows ...
AI @Scale
AI @Scale 2020: F3: Next-generation Feature Framework at Facebook
We will discuss the next generation feature framework in development at Facebook. This new framework enables efficient experimentation in building machine learning features to semantically model behaviors and intent of users, and ...
AI @Scale
AI @Scale 2020: High Performance Observability Across the ML Lifecycle
The scale and breadth of ML applications have increased dramatically thanks to scalable model-training and serving technologies. Builders of enterprise ML systems often have to contend with both real-time inference and massive amounts ...
Systems @Scale Remote Edition — Summer 2020
Systems @Scale Summer 2020 Q&A
As part of the Systems @Scale event, engineers participated in a series of live Q&As about the engineering work presented in the technical talks. We’ve collected those questions and the engineers’ responses below. Asynchronous ...