- WATCH NOW
- 2024 EVENTS
- PAST EVENTS
- 2023
- 2022
- February
- RTC @Scale 2022
- March
- Systems @Scale Spring 2022
- April
- Product @Scale Spring 2022
- May
- Data @Scale Spring 2022
- June
- Systems @Scale Summer 2022
- Networking @Scale Summer 2022
- August
- Reliability @Scale Summer 2022
- September
- AI @Scale 2022
- November
- Networking @Scale Fall 2022
- Video @Scale Fall 2022
- December
- Systems @Scale Winter 2022
- 2021
- 2020
- 2019
- 2018
- 2017
- 2016
- 2015
- EXPLORE TOPICS
- Blog & Video Archive
- Speaker Submissions
- About @Scale
Data, Systems and Networking
5/23/2024
NAVIGATING DATA'S NEXT GREAT SHIFT
Data is the foundational building block of GenAI. As we navigate this transition we face exciting new opportunities as well as long standing challenges in the data space. In this conversation we’ll explore these opportunities as well as lessons we can draw from the past. We’ll cover some of the things that need to be […]
WATCH VIDEO TRENDING POSTS
SORT
TOPIC
@SCALE SERIES
TYPE
DATE
TAGS
17 RESULTS
CLEAR ALL
Data, Systems and Networking
6/11/2024
Evolution of AI Training Orchestration with Serverless Ecosystem
Introduction The past couple of years have been nothing short of extraordinary for technology, especially for artificial intelligence (AI). Amidst this rapid progress, machine learning (ML) engineers have found themselves trapped in a relentless cycle of model training, testing, and refinement. But what if we could ease and expedite this process for them? In this […]
READ ARTICLE
Data, Systems and Networking
6/10/2024
Evolving Cluster Management: Upleveling Abstractions
At Meta, our vast infrastructure spans over 20 data center regions and comprises millions of machines, all of which work together to power services that serve billions of users worldwide. To effectively manage this enormous scale of resources and ensure optimal capacity and operational efficiency, we rely on our large-scale cluster-management system, Twine, previously introduced […]
READ ARTICLE
Data, Systems and Networking
5/23/2024
Fireside Chat: Evolution of AI-First Data Infrastructure
The fireside chat will focus on the key trends that have emerged over the past year and a half in Data infrastructure, delve into the biggest challenges in building a world-class, AI-first data infrastructure and discuss how Meta approaches problem selection for research.
WATCH VIDEO
Data, Systems and Networking
5/23/2024
BEAM UP YOUR GENAI USAGE: USABILITY, EFFICIENCY, RELIABILITY WITH APACHE BEAM
Apache Beam, a data processing framework, has seen a surge in adoption for GenAI use cases. This growth can be attributed to our focus on building a user-friendly, efficient, and reliable platform. Beam ML empowers GenAI practitioners to dedicate their expertise to core tasks by removing technical hurdles and streamlining workflows. This approach has unlocked […]
WATCH VIDEO
Data, Systems and Networking
5/23/2024
SMARTER, FASTER DATA ANALYTICS WITH GENERATIVE AI AND MACHINE LEARNING
Data volume continues to increase and so is the need for large number of data workers to derive insights from data. This puts pressure on the data teams as well as requires scalable data infrastructure that can be programmed easily, even by low-code developers, and operated seamlessly at scale without active intervention of data operators. […]
WATCH VIDEO
Data, Systems and Networking
5/23/2024
TAKING FLIGHT WITH INTERACTIVE ANALYTICS
Modern data processing systems were designed at a time when hardware looked very different than it does today. And as the early hype around big data settled, it became clear that most analytics only use a subset of the data that is available.
WATCH VIDEO
Data, Systems and Networking
5/23/2024
LARGE-SCALE DATA GRAPH: SCALE AND OPTIMIZE PRIVACY & SECURITY IN OFFLINE DATA SYSTEMS
Meta operates large-scale offline data systems across Data Warehouse, Stream Data Processing and Monitoring & Observability. Privacy, security, and other cross-cutting management and governance concerns are critical in the data infrastructure. This talk explains how we map out the offline data systems using unified metadata representation of assets and link them through the relationships and […]
WATCH VIDEO
Data, Systems and Networking
5/23/2024
A CASE STUDY IN BRIDGING PRODUCTION SOFTWARE AND DATA PRACTICES FOR LLM MODEL TRAINING USING SNOWFLAKE
We present a case study detailing the utilization of Snowflake, a cloud-based data platform, in various stages of the LLM data pipeline from initial annotation to LLM model productionization. The system we have built brings production software and data practices to the field of LLM model training. We describe how every step in the system […]
WATCH VIDEO
Data, Systems and Networking
5/23/2024
SCALING META’S INFRA WITH GENAI: JOURNEY TO FASTER AND SMARTER INCIDENT RESPONSE
With billions of active users, Meta’s incident response process is critical to maintaining our reliability commitments. In this talk, we explore the challenges we face due to the complexity and scale of our operations and how we are leveraging AI to revolutionize onboarding responders and root cause analysis. Join us to learn about our journey, […]
WATCH VIDEO