Videos & Articles
Clear
The @Scale Conference 2019
Register now for @Scale 2019!
Registration is officially open for @Scale 2019. @Scale is an invitation-only technical conference for engineers who build or maintain large-scale systems. This year’s event will be held at the San Jose Convention Center on October ...
Systems @Scale 2019
Our Code of Conduct
Every @Scale event participant has the right to enjoy his or her experience without fear of harassment, discrimination, or condescension.
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Keeping Lite ‘light’ Techniques for Keeping Our APK as Small as ~1MB
Facebook Lite is a lightweight version of the Facebook App, targeted to emerging markets. In this talk Dekel Naar, Software Engineer with the Facebook Lite Performance Team, covers some of our team’s efforts to keep Facebook’s APK as ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Don’t Miss the Train: Shipping Apps and Beyond
Each day, Facebook is updated with new features, bug fixes, and product improvements. Each day, Facebook also ships mobile apps to mobile devices around the world. Coordinating thousands of engineers, hundreds of product changes, and ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Reactive Extensions for Mobile Apps: Getting Started
Reactive Applications have been extremely popular in all fields of programming: web apps, backend, and of course mobile applications! In this talk, Shai Mishali, iOS Tech Lead with Gett, discusses the building blocks of Reactive ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Keynote Address
Joey Simhon, Engineering Director at Facebook, delivers a keynote address at the Mobile@Scale Tel Aviv conference and addressing the challenges of mobile development at scale.
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Mobile development process automation
Felix Krause, Tech Lead for fastlane at Google, talks about how you can leverage existing open source infrastructure to build powerful tools to automate your mobile development processes. This includes topics like accessing the new ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Using Mobile to Help Your Business
Mobile technology offers a lot of unique and interesting ways it can help you advance your business goals. In this talk, Guy Shaviv, GM of Houzz Israel and Mobile Development Manager, discusses how Houzz has used the capabilities ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Building for Emerging Markets
Emerging markets will account for over 90% of new mobile subscribers globally by 2020. If you’re not currently building your products with these users in mind then you’re missing out on a huge growth lever. In this talk, ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – Flipper: An extensible mobile app debugger
In this talk, Daniel Buchele, Front-End Engineer at Facebook, discusses Flipper, an open-source debugging tool that helps mobile developers get a better understanding of what is happening inside their apps. Built-in features allow ...
Mobile @Scale Tel Aviv
Mobile@Scale Tel Aviv – YOLO Releases Considered Harmful: Running an Effective Mobile Engineering Team
Organizations often worry about their mobile teams. Sometimes they are a bit separate. There’s often this inexplicable hostility to mentions of “React Native.” Why do bug fixes take so long to get to production, and what are all these ...
Boston Data @Scale 2018
Boston Data @Scale – Presto: Pursuit of Performance
Andrii Rosa, Software Engineer at Facebook, and Matt Fuller, VP of Engineering at Starburst, discuss Presto, an open source, distributed SQL engine. Presto is widely recognized for its low-latency queries, high concurrency, and native ...
Boston Data @Scale 2018
Boston Data @Scale 2018 – Protecting Patient Privacy While Using Real-World Evidence
Philip Wickline, Chief Technology Officer at OM1, discusses the challenges of working with patient data and presents solutions to combining large-scale healthcare datasets while still preserving patient privacy.
Boston Data @Scale 2018
Boston Data @Scale 2018 – Balancing Flexibility and Control with Database Deployments
Tanya Cashorali, Founder & CEO of TCB Analytics, discusses the expanding range of options for database technologies and deployment strategies, whether on-premises or cloud-based. With this growth often comes the desire to implement ...
Boston Data @Scale 2018
Boston Data @Scale 2018 – Lessons and Observations Scaling a Time-Series Database
Ryan Betts, Director of Platform Engineering at InfluxData, discusses several lessons learned while scaling the company’s time-series platform across a large number of deployments – from single server open source instances ...
Boston Data @Scale 2018
Boston Data @Scale 2018 – Leveraging Sampling to Reduce Data Warehouse Resource Consumption
Gabriela Jacques Da Silva & Donghui Zhang, Software Engineers at Facebook, discuss the approaches they have been using to support the computation of analytical dashboards using sampling, where approximations result in negligible ...
Boston Data @Scale 2018
Boston Data @Scale 2018 – Deleting Data @ Scale
Ben Strahs, Software Engineer for Privacy & Data Use at Facebook, discusses Facebook’s Deletion Framework, a system built to automatically detect gaps, ensure completeness, and make sure the correct data is deleted.
Boston Data @Scale 2018
Boston Data @Scale 2018 – Building Highly Reliable Data Pipelines at Datadog
Every day, Datadog runs massive data pipelines to power core functionality. In this talk, Staff Data Engineer Jeremy Karn covers best practices at Datadog to ensure that the company reliably delivers this functionality while processing ...
Boston Data @Scale 2018
Boston Data @Scale 2018 – Kubeflow: Portable Machine Learning on Kubernetes
Michelle Casbon, Senior Engineer at Google, discusses how Kubeflow, a framework on Kubernetes, addresses three of the biggest development challenges: scalability, portability, and composability.
The 2018 @Scale Conference
@Scale 2018: Presto: Fast SQL on everything
Presto is an open source, high-performing, distributed relational database system targeted at making SQL analytics over big data fast and easy at Facebook. It provides rich SQL language capabilities for data engineers, data scientists, ...
The 2018 @Scale Conference
@Scale 2018: Resource management at scale for SQL analytics
Apache Impala is a highly popular open source SQL interface built for large-scale data warehouses. Impala has been deployed in production at more than 800 enterprise customers as part of Cloudera Enterprise, managing warehouses up to ...
The 2018 @Scale Conference
@Scale 2018: Accelerate machine learning at scale using Amazon SageMaker
Organizations are using machine learning to address a series of business challenges, ranging from product recommendations, demand forecasting, customer churn, medical research, and many more. The ML process includes framing the problem ...
The 2018 @Scale Conference
@Scale 2018: Applied machine learning at Facebook: An infrastructure perspective
Machine learning sits at the core of many essential products and services at Facebook. In this talk, Kim Hazelwood, Engineering Manager, Facebook, describes the hardware and software infrastructure that supports machine learning at ...
The 2018 @Scale Conference
@Scale 2018: Testing strategy with multi-app orchestration
Uber’s dual-app experience introduces an interesting challenge for mobile functional testing. In this talk, Leslie Lei, Software Engineer at Uber, introduces methods of doing mobile E2E testing while orchestrating multiple apps. ...
The 2018 @Scale Conference
@Scale 2018: Regression testing against real traffic on a Big Data reporting system
Adobe Analytics’ underlying query API handles thousands of complex reporting queries per second across a user base of hundreds of thousands. In his @Scale talk, Trenton Davies, Principal Scientist at Adobe, discusses how the Adobe ...
The 2018 @Scale Conference
Friends don’t let friends deploy black-box models: The importance of intelligibility in machine learning
In machine learning, a trade-off often must be made between accuracy and intelligibility. The most accurate models usually are not very intelligible (e.g., deep nets), and the most intelligible models usually are less accurate (e.g., ...
The 2018 @Scale Conference
@Scale 2018: Goku: Pinterest’s in-house time-series database
In this presentation, Tian-Ying Chang, Senior Staff Engineer and Manager of the Storage and Caching Team at Pinterest, and Jinghan Xu, Software Engineer at Pinterest, discuss Goku, a highly scalable, cost-effective, and high-performant ...
The 2018 @Scale Conference
@Scale 2018: Run your database like a CDN
Modern businesses serve customers around the globe, but few manage to avoid sending far-flung customer requests across an ocean (or two!) to application servers colocated with a centralized database. This presents two significant ...
The 2018 @Scale Conference
@Scale 2018: Scaling concurrency bug detection with the Infer static analyzer
Concurrency is hard, and inevitable, given the evolution of computing hardware. Helping programmers avoid the exotic and messy bugs that come with parallelism can be a productivity multiplier but is also elusive. Implementing such a ...
The 2018 @Scale Conference
@Scale 2018: Machine learning testing at scale
Machine learning is infused in all walks of life — and in a lot of Google products, including Google Home, Search, Gmail, and more, and in systems such as those used by self-driving cars and fraud detection. A tremendous amount of ...
The 2018 @Scale Conference
@Scale 2018: Amazon Aurora: Design considerations for high throughput cloud-native relational databases
Amazon Aurora is a relational database service for online transaction processing (OLTP) workloads offered as part of Amazon Web Services. In this talk, Sailesh Krishnamurthy, General Manager at Amazon Web Services, describes the ...
The 2018 @Scale Conference
@Scale 2018: Distributed AI with Ray
Over the past decade, the bulk synchronous processing (BSP) model proved highly effective for processing large amounts of data. Today, however, we are witnessing the emergence of a new class of applications — AI workloads. These ...
The 2018 @Scale Conference
@Scale 2018: Automated fault-finding with Sapienz
Sapienz designs system tests that simulate user interactions with mobile apps. It automatically finds apps’ crashes, and localizes them, tracks them, and triages them to developers. In his talk, Ke Mao, Software Engineer at ...
The 2018 @Scale Conference
@Scale 2018: Computer vision at scale as cloud services
In this talk, Cha Zhang, Principal Researcher at Microsoft Cloud & AI, describes how, as computer vision matures and becomes ready for real-world applications, Microsoft’s team has set a mission to scale and democratize it ...
The 2018 @Scale Conference
@Scale 2018: MLPerf: A suite of benchmarks for machine learning
The MLPerf effort aims to build a common set of benchmarks that enables the machine learning field to measure system performance for both training and inference from mobile devices to cloud services. In this presentation, Cliff Young, ...
The 2018 @Scale Conference
@Scale 2018: Integrated Symbolic Execution for Space-Time Analysis of Code: Scalability challenges
Attacks relying on the space-time complexity of algorithms implemented by software systems are gaining prominence. Software systems are vulnerable to such attacks if an adversary can inexpensively generate inputs that cause the system ...
The 2018 @Scale Conference
@Scale 2018: Artificial intelligence at Orbital Insight
Orbital Insight is a geospatial big data company leveraging the rapidly growing availability of satellite, UAV, and other geospatial data sources to understand and characterize socio-economic trends at global, regional, and hyperlocal ...
The 2018 @Scale Conference
@Scale 2018: One World: Scalable resource management
As Facebook’s user base and family of applications grows, it’s important to ensure correctness and performance across many hardware and software platforms. Managing all these combinations for testing would be an operational ...
The 2018 @Scale Conference
@Scale 2018 Keynote: Glow: A community-driven approach to AI
In this keynote address, Jason Taylor, Vice President of Infrastructure at Facebook, announces the next steps in Facebook’s efforts to build a hardware ecosystem for machine learning (ML) through partner support of the Glow compiler. ...
The 2018 @Scale Conference
@Scale 2018 Keynote: Inside NVIDIA’s AI infrastructure for self-driving cars
In this talk, Clément Farabet, VP of AI Infrastructure at NVIDIA discusses NVIDIA’s production-level, end-to-end infrastructure and workflows to develop AI for self-driving cars. He explores the platform that supports continuous data ...
The 2018 @Scale Conference
@Scale 2018 Keynote: A golden age for computer architecture
The end of Dennard scaling and Moore’s law are not problems that must be solved but facts that, if accepted, offer breathtaking opportunities. In his @Scale Conference keynote, David Patterson, Distinguished Engineer at Google and ...
The 2018 @Scale Conference
Meet a Keynote Speaker: Clément Farabet, VP of AI Infrastructure, NVIDIA
Inside NVIDIA’s AI infrastructure for self-driving cars With the race to bring self-driving cars to market, deep learning is crucial to the automotive industry. At the 2018 @Scale Conference, Clément Farabet, VP of AI ...
Systems @Scale
Systems @Scale 2018 – Resolving Outages Faster with Better Debugging Strategies
Liz Fong-Jones, Staff Site Reliability Engineer at Google, explains why building more dashboards isn’t the solution — using dynamic query evaluation and integrating tracing is.
Systems @Scale
Systems @Scale 2018 – Lyft’s Envoy: Embracing a Service Mesh
Matt Klein, Software Engineer at Lyft, discusses why Lyft developed Envoy, focusing primarily on the operational agility that the burgeoning service mesh paradigm provides, with a particular focus on microservice networking observability.
Systems @Scale
Systems @Scale 2018 – Scaling Data Distribution at Facebook Using LAD
Rounak Tibrewal and Ali Zaveri, Software Engineers at Facebook, describe the design for LAD, which leverages peer-to-peer transfers, and share lessons learned from launching it in production.
Systems @Scale
Systems @Scale 2018 – Kubernetes Application Migrations: How Shopify Moves Stateful Applications Between Clusters and Regions
Ian Quick, Production Engineering Lead at Shopify, shares how Shopify manages high availability and maintenance through low-downtime migrations for stateful applications.
Systems @Scale
Holding It in @Scale: The systemd-tails on Containers, Composable Services, and Runtime Fun Times
Madelaine Boyd (Software Engineer) and Lindsay Salisbury (Production Engineer) at Facebook talk about Facebook’s deployment of images, give the dish on btrfs, and explain how systemd works as a low cognitive overhead runtime for ...
Systems @Scale
Systems @Scale 2018 – Keynote With Jay Parikh
Jay Parikh, Vice President of Engineering at Facebook, explains how Facebook updates core software and adds features without disrupting operations.
Systems @Scale
Systems @Scale 2018 – Web@FB: Releasing Facebook.com Quickly, Continuously, and Reliably
Anca Agape, Software Engineer at Facebook, discusses aspects of managing the Web Tier (the servers and software powering Facebook.com) and giving thousands of Facebook engineers a safe way to move quickly at scale.
Systems @Scale
Systems @Scale 2018 – Compute-as-a-Service: Moving Toward a Global Shared Fleet
Ben Christensen, Software Engineer at Facebook, discusses how the company is working to evolve the systems that support its services to the next order of magnitude.
Systems @Scale
Systems @Scale 2018 – Rebuilding the Inbox: The Corporate and Cultural Adventures of Modernizing Yahoo Mail
Jeff Bonforte, SVP of Communication Products, Data, and Research at Oath, discusses and shares learnings from modernizing the entire Yahoo Mail Stack.
Systems @Scale
Systems @Scale 2018 – Geo-Replication in Amazon DynamoDB Global Tables
Doug Terry, Senior Principal Technologist at Amazon AWS, explains a recently launched feature that adds support for global tables that are replicated in AWS regions throughout the world.
The @Scale Conference 2017
The 2017 @Scale conference
Never been to an @Scale? Check out 2017’s show to learn more.
Networking @Scale 2018
Networking @Scale 2018 – A Learning Platform for Network Intent Graph Modeling
Elnaz Jalilipour Alishah, Data Scientist at Microsoft, discusses how Microsoft is tackling the design and resilience of their global backbone network using machine learning techniques such as optimization and simulation.
Networking @Scale 2018
Networking @Scale 2018 – IPv6 Measurements at Facebook
Paul Saab, Software Engineer at Facebook, and Sarah Chen, Software Engineer at Facebook, announce the availability of country-specific IPv6 adoption data.
Networking @Scale 2018
Networking @Scale 2018 – Edge Fabric: Steering Oceans of Content to the World
Niky Riga, Software Engineer at Facebook, discusses the design of Edge Fabric, Facebook’s system for managing egress load back to the Internet.
Networking @Scale 2018
Networking @Scale 2018 – Load Balancing at Hyperscale
Alan Halachmi, Senior Manager, Solutions Architecture at Amazon, and Colm MacCarthaigh, Senior Principal Engineer at Amazon, discuss HyperPlane, a fundamental system that underlies Amazon’s S3 Load Balancer, Elastic Filesystem, ...
Networking @Scale 2018
Networking @Scale 2018 – Networking Challenges in Gaming
Malachi Middlebrook, Network Architect at Blizzard, and Philip Orwig, Principal Software Engineer at Blizzard, discuss how games like Overwatch, World of Warcraft, and Diablo work around the realities and restrictions of the network in ...
Networking @Scale 2018
Networking @Scale 2018 – Optics Scaling Challenges
Mark McKillop, Network Engineer at Facebook, and Katharine Schmidtke, Sourcing Manager of Network Hardware at Facebook, talk about challenges in Facebook’s optical networks, both in backbone and in data centers.
Networking @Scale 2018
Networking @Scale 2018 Scaling the Facebook Backbone Through Zero Touch Provisioning (ZTP)
David Swafford, Network Engineer at Facebook, details a new system the team has built called “Vending Machine” and how that has helped Facebook automate complex, manual provisioning procedures.
Networking @Scale 2018
Networking @Scale 2018 – Layer 4 Load Balancing at Facebook
Nitika Shirokov, Production Engineer at Facebook, announces the open-sourcing of a new L4 load balancer, Katran.
Networking @Scale 2018
Networking @Scale 2018 – Networking Across 3 Decades of IBM Supercomputers
Alan Benner, Senior Technical Staff Member at IBM, gives an overview of how supercomputing has tackled high-speed optical networking over the years.
Video @Scale 2018
Video @Scale 2018 – Li-Tal Mashiach, Facebook
Li-Tal Mashiach, Engineering Manager of RTC Infrastructure at Facebook, discusses scaling challenges and opportunities for real-time communication.
Video @Scale 2018
Video @Scale 2018 – Anne Aaron and Andrey Norkin, Netflix
Anne Aaron, Director of Video Algorithms at Netflix, and Andrey Norkin, Senior Research Scientist at Netflix, discuss AV1 quality and compression evaluation.
Video @Scale 2018
Video @Scale 2018 – Jana Iyengar, Fastly
Jana Iyengar, Distinguished Engineer at Fastly, delivers a talk titled, “QUIC: The Next Great Internet Transport.”
Video @Scale 2018
Video @Scale 2018 – Matt Feiszli, Facebook
Matt Feiszli, Computer Vision Research Scientist at Facebook, discusses approaches to understanding video content at scale.
Video @Scale 2018
Video @Scale 2018 – Nick Chadwick, Mux
Nick Chadwick, Software Engineer at Mux, discusses per-title encoding for videos.
Video @Scale 2018
Video @Scale 2018 – Omer Luzzatti, VDMS
Omer Luzzatti, VP of Engineering at Verizon Digital Media Services, delivers a talk titled, “Moving from TV to Personalized OTT: Challenges and Solutions.”
Video @Scale 2018
Video @Scale 2018 – Shankar Regunathan, Hans Fugal, Facebook, and Balu Adsumilli, YouTube
Shankar Regunathan, Video Engineer at Facebook, Hans Fugal, Audio Engineer at Facebook, and Balu Adsumilli, Manager, Future Media Technologies at YouTube, discuss measuring audio and video quality at scale.
Video @Scale 2018
Video @Scale 2018 – Dejan Curcic, Facebook
Dejan Curcic, Software Engineer Manager at Facebook, discusses proactive CDNs and video delivery.
Video @Scale 2018
Video @Scale 2018 – Sabyasachi Roy and Peter Knowles
Sabyasachi Roy, a Software Engineer at Facebook, and Peter Knowles, a Production Engineer at Facebook, discuss how to scale for growth and change.
Video @Scale 2018
Video @Scale 2018 – Yue Chen, Google
Yue Chen, Senior AV1 Engineer at Google, gives a technical overview of the AV1 video codec.
Fighting Abuse @Scale
Fighting Abuse @Scale 2018 – Nathan Hurst
Nathan Hurst, Software Engineer at Facebook, talks about using machine learning techniques and human reviewers to identify bad ads.
Fighting Abuse @Scale
Fighting Abuse @ Scale – Michelle Ganbaum and Benjamin Braun
Michelle Ganbaum and Benjamin Braun of Facebook speak at Fighting Abuse @Scale 2018. They discuss what happens when a URL is shared on Facebook, what makes a URL harmful, how Facebook identifies harmful URLS and protects users, and how ...
Fighting Abuse @Scale
Fighting Abuse @Scale – Michael McNally and Lauren Bose
Michael McNally, Engineering Director at Facebook, and Lauren Bose, Data Scientist at Facebook, speak at Fighting Abuse @Scale 2018 about strategies to combat misinformation.
Fighting Abuse @Scale
Fighting Abuse @ Scale – Jenelle Bray and Carlos Faham
Jenelle Bray, Engineering Manager at LinkedIn, and Carlos Faham, Senior Software Engineer at LinkedIn, speak at Fighting Abuse @Scale 2018 about measuring the performance of fake account models.
Fighting Abuse @Scale
Fighting Abuse @Scale 2018 – Nektarios Leontiadis
Nektarios Leontiadis, Threat Research Scientist at Facebook, speaks at Fighting Abuse @Scale 2018 about disrupting adversarial infrastructures with honeypots.
Performance @Scale 2018
Performance @Scale 2018 – Opening Remarks
Bill is a Vice President at Facebook, in the Infrastructure group, overseeing AI/Applied Machine Learning infrastructure, performance and capacity engineering, and hardware validation engineering. Since joining Facebook in 2009, Bill ...
Performance @Scale 2018
Execution Graphs: Distributed trace processing for performance regression detection
Execution Graphs are a data correlation and visualization model used within Azure to understand the performance and reliability of Azure VM deployment operations. Within Azure, multiple services are responsible for various aspects of ...
