TOPIC: Mobile, Video and Web

RTC @Scale 2024

March 20, 2024 @ 9am PT - 3pm PT

RTC @Scale is for engineers who develop and manage large-scale real-time communication (RTC) systems serving millions of people. The operations of large-scale RTC systems have always involved complex engineering challenges which continue to attract attention due to the explosive growth of RTC over the last couple years. The @Scale community focuses on bringing people together to discuss these challenges and collaborate on the development of new solutions.

Register today and check back for upcoming speaker and agenda announcements!

RSVPS CLOSED
AGENDA SPEAKERS

ABOUT EVENT

RTC @Scale 2024 will be hosted virtually. Joining us are speakers from Intel, LiveKit, Visionular, BlogGeek.me and Meta. The event will feature talks themed around four main topic areas: Core AV in RTC, Use of ML, Infrastructure supporting RTC at scale and Open Source.

EVENT AGENDA

Event times below are displayed in PT.

March 20

09:00 AM - 09:05 AM
Host Welcome
Speaker Li-Tal Mashiach,Meta
09:05 AM - 09:20 AM
Keynote: From Codec to Connection

As the ability for more people to communicate in new ways expands, consumer needs are centered around fostering human connection through technology. Nitin’s talk will include the primary user needs which are driving the future of RTC, and how the latest innovations are shaping the future ahead including in the Metaverse.

Speaker Nitin Khandelwal,Meta
SESSION 1: REAL TIME QUALITY @ PLANET SCALE
09:20 AM - 09:40 AM
Revamping Audio Quality for RTC Part 1: Beryl echo cancellation

Providing a natural real-time audio communication experience at the scale of billions of users across WhatsApp, Instagram and Messenger is challenging, particularly given the diversity of devices and network conditions we encounter. Echo (hearing yourself back) and audio quality under low bandwidth network conditions, are two well known problems that can seriously disrupt the call experience. In this talk, we will discuss the results of our long-term investments and innovation in these two areas as well as recent launches that revamp the core of Meta’s audio processing stack powering calling across our Family of Apps.

Speaker Sriram Srinivasan,Meta
Speaker Hoang Do,Meta
ADDITIONAL RESOURCES
IMPROVING AUDIO QUALITY FOR CALLING ACROSS META’S FAMILY OF APPS  read more
09:40 AM - 10:00 AM
Revamping Audio Quality for RTC Part 2: MLow audio codec

Providing a natural real-time audio communication experience at the scale of billions of users across WhatsApp, Instagram and Messenger is challenging, particularly given the diversity of devices and network conditions we encounter. Echo (hearing yourself back) and audio quality under low bandwidth network conditions, are two well known problems that can seriously disrupt the call experience. In this talk, we will discuss the results of our long-term investments and innovation in these two areas as well as recent launches that revamp the core of Meta’s audio processing stack powering calling across our Family of Apps.

Speaker Jatin Kumar,Meta
Speaker Bikash Agarwalla,Meta
10:00 AM - 10:20 AM
Improving International Calls

Long distance calls can be challenging, but Meta's WhatsApp and Remote Presence orgs have some valuable insights to share. This presentation will explore how Meta's global network of edge clusters can be leveraged to build a stable and high-quality network infrastructure for serving over 500+ million long distance video and audio calls worldwide on daily bases. By utilizing Meta's extensive resources and expertise, we can improve the user experience and provide more reliable connections for long distance calls.

Speaker Yi Zhang,Meta
Speaker Saish Gersappa,Meta
ADDITIONAL RESOURCES
IMPROVING INTERNATIONAL CALLS  read more
10:20 AM - 10:40 AM
Live Q&A with Speakers
Moderator Kaustubh Kalgaonkar,Meta
Speaker Sriram Srinivasan,Meta
Speaker Hoang Do,Meta
Speaker Jatin Kumar,Meta
Speaker Bikash Agarwalla,Meta
Speaker Yi Zhang,Meta
Speaker Saish Gersappa,Meta
10:40 AM - 11:00 AM
Break
SESSION 2: NEXT-GEN RTC VIDEO
11:00 AM - 11:20 AM
Improving Video Quality for RTC

This presentation covers how Meta is improving the video quality for RTC apps by moving to next gen Video Codecs like AV1 to improve quality for low bandwidth, bringing HD video to high end networks and devices.

Speaker Shyam Sadhwani,Meta
Better video for mobile RTC with AV1 and HD  read more
11:20 AM - 11:40 AM
AV1 at the Coalface: Challenges for Delivering a Next-Generation Codec for RTC

What does it take to develop and deploy AV1 in RTC applications? This presentation will discuss how RTC is different from other video coding applications and why that is challenging for developing an encoder that performs well. While other applications typically place coding performance above all other requirements, in RTC an encoder must meet demanding trade-offs with computational cost and be subject to many constraints. As encoding standards get more complex, meeting these constraints requires careful consideration of how to approach encoding.

Speaker Thomas Davies,Visionular
11:40 AM - 12:00 PM
Delivering Immersive 360-degree Video over 5G Networks

5G and Edge Computing are now enabling new user experiences for immersive media such as 360-degree video, where content creation is in real-time and equally uses upstream and downstream links. Here we will present a 360 Immersive Media solution using the Intel Open WebRTC Toolkit (OWT) and Intel edge platform, which is composed of media ingestion from multiple cameras, remote control, and distribution over 5G networks. A performance evaluation showing the gain in terms of bandwidth and latency will be presented as well. In addition, a more generic framework is proposed for delivering spatially partitioned content using RTP.

Speaker Gang Shen,Intel
12:00 PM - 12:20 PM
Enhanced Real-Time Communication (RTC) Network Resiliency with Long Term Reference and Reed Solomon Code

Network resiliency algorithm is a key part to ensure seamless media in RTC. We will discuss Meta's recent improvements to Network Resiliency with Long Term Reference (LTR) and Reed Solomon Code.

Speaker Fengdeng Lyu,Meta
Speaker Fan Zhou,Meta
ADDITIONAL RESOURCES
ENHANCING VIDEO NETWORK RESILIENCY WITH LTR AND RS CODE  read more
12:20 PM - 12:40 PM
Live Q&A with Speakers
Moderator Jie Dong,META
Speaker Shyam Sadhwani,Meta
Speaker Thomas Davies,Visionular
Speaker Gang Shen,Intel
Speaker Fengdeng Lyu,Meta
Speaker Fan Zhou,Meta
12:40 PM - 01:00 PM
Break
SESSION 3: RTC - THE NOT SO OBVIOUS
01:00 PM - 01:20 PM
The Past and Future of WebRTC, 2024 Edition

WebRTC is going through turmoil these days. On one hand, contributions aren’t high to the codebase, but on the other hand, we see a lot of minor improvements and changes, hinting at the future of WebRTC. Who are the people contributing to the base libWebRTC codebase used in all modern browsers today, and what are the areas of interest they are covering? This is what we will review during this session, trying to glean out of these tidbits where we are headed to with WebRTC.

Speaker Tsahi Levent-Levi,BlogGeek.me
01:20 PM - 01:40 PM
RTC Observability

In this talk, we will go over observability for RTC applications which is critical to ensuring good operational monitoring and debugging to scale across billions of users. We'll cover the entire space in detail and also dive into the architecture of RAlligator, a real time data aggregation service built specifically for analyzing data from all Meta RTC applications. Finally, we'll go over all the different debugging tools and various different types of logs used by Rsys.

Speaker Mandeep Deol,Meta
Speaker Ishan Khot,Meta
ADDITIONAL RESOURCES
RTC OBSERVABILITY  read more
01:40 PM - 02:00 PM
Open Source from One to At Scale

Sean will talk about lessons learned from his journey in Open Source. The joys of building something with huge impact. The frustrations when Open Source is done wrong. The success that can be found when doing it effectively. When done well Open Source has huge benefits for users, developers and companies.

Speaker Sean DuBois,LiveKit
02:00 PM - 02:20 PM
Machine Learning (ML) based Bandwidth Estimation and Congestion Control for RTC

The existing congestion control/bandwidth estimation algorithms have several hand-tuned parameters and actions depending on network conditions, leading to challenges in engineering, experimentation, maintenance, and operational monitoring. A machine learning based approach can offer a cleaner alternative with improved performance by addressing the problem holistically across layers (BWE, Network Resiliency, and Transport). This talk outlines our method for addressing BWE and CC issues in RTC using machine learning, discussing obstacles encountered, recent findings, and upcoming plans. Specifically, we explore network characterization and prediction problems, showcasing a few representative examples.

Speaker Liyan Liu,Meta
Speaker Santhosh Sunderrajan,Meta
Optimizing RTC bandwidth estimation with machine learning  read more
02:20 PM - 02:40 PM
Live Q&A with Speakers
Moderator Pavel Punsky,Meta
Speaker Tsahi Levent-Levi,BlogGeek.me
Speaker Mandeep Deol,Meta
Speaker Ishan Khot,Meta
Speaker Liyan Liu,Meta
Speaker Santhosh Sunderrajan,Meta
Speaker Sean DuBois,LiveKit
02:40 PM - 02:50 PM
Closing Remarks
Speaker Li-Tal Mashiach,Meta

SPEAKERS AND MODERATORS

Li-Tal is a key leader in Remote Presence org in Meta, supporting media in... read more

Li-Tal Mashiach

Meta

Nitin is a user-needs driven engineering leader. He leads the Consumer engineering organization responsible... read more

Nitin Khandelwal

Meta

Sriram Srinivasan leads the audio teams at Meta working on technologies for next-gen real-time... read more

Sriram Srinivasan

Meta

Hoang Do leads the Remote Presence audio algorithms team at Meta, working on audio... read more

Hoang Do

Meta

Jatin Kumar is a software engineer and the Tech Lead for the WhatsApp Calling... read more

Jatin Kumar

Meta

Bikash Agarwalla is an Engineering Manager at WhatsApp Inc working on Calling products for... read more

Bikash Agarwalla

Meta

Yi is a software engineer in Meta's Remote Presence org, which is responsible for... read more

Yi Zhang

Meta

Saish has spent over two decades solving networking problems related to security and real... read more

Saish Gersappa

Meta

Kaustubh is a researcher specializing in artificial intelligence at Meta, based in Bellevue, Washington.... read more

Kaustubh Kalgaonkar

Meta

Shyam Sadhwani is a software engineer at Meta since 2016. He works on improving... read more

Shyam Sadhwani

Meta

Thomas's focus at Visionular is the development and deployment of real-time, high-performance video codecs.... read more

Thomas Davies

Visionular

Gang Shen is a system architect in Intel Network and Edge Group focusing on... read more

Gang Shen

Intel

Fengdeng is a software engineer at Meta. Being a veteran in the real-time communication... read more

Fengdeng Lyu

Meta

Fan Zhou has worked for 4 years at Meta, where he has been focused... read more

Fan Zhou

Meta

Jie is a software engineer at Meta, where she is currently part of the... read more

Jie Dong

META

I am a developer by heart. Always have been. The thing is, I found... read more

Tsahi Levent-Levi

BlogGeek.me

Mandeep graduated from the University of Waterloo in 2007 with a bachelors of applied... read more

Mandeep Deol

Meta

I was the lead engineer of the team that built Rsys, a client side... read more

Ishan Khot

Meta

Sean created Pion WebRTC, WebRTC for the Curious, Broadcast Box and added WebRTC support... read more

Sean DuBois

LiveKit

Dr. Liyan is the Machine Learning (ML) lead and expert for networking projects in... read more

Liyan Liu

Meta

Dr. Sunderrajan is the technical lead for ML-based bandwidth estimation and congestion control in... read more

Santhosh Sunderrajan

Meta

Pavel is a Software Engineer at Meta, working on the real time communications RTC... read more

Pavel Punsky

Meta

LATEST NOTES

RTC @Scale
03/20/2024
Improving Audio Quality for Calling across Meta’s Family of Apps
Introduction We are excited to announce the rollout of Beryl, our new, advanced, echo-and-noise-suppression solution to improve audio quality when...
RTC @Scale
03/20/2024
Improving International Calls
Additional Author: Woo Xie Introduction Meta has some of the world’s most widely used calling products: WhatsApp, Messenger, Instagram. One...
RTC @Scale
03/20/2024
Enhancing Video Network Resiliency With LTR and RS Code
Introduction Video calling brings people together despite the geographic distance between them. Amidst recent years’ significant growth in RTC usage,...
RTC @Scale
03/20/2024
RTC Observability 
Introduction The RTC Observability team at Meta aims to create a highly reliable analytics platform that provides visibility into call...
UPCOMING EVENT   07/31/2024 AI @Scale

AI Infra @Scale 2024

Meta's Engineering and Infrastructure teams are excited to host AI Infra @Scale, a one-day virtual event featuring a range of speakers from Meta who will unveil the latest AI infrastructure investments and innovations powering Meta's...
UPCOMING EVENT   August 7, 2024 Product @Scale

Product @Scale 2024

Product @Scale conferences are designed for technologists who work on solving complex product problems at scale. The @Scale community focuses on bringing forward people's experiences in creating innovative solutions to large-scale products serving millions or...
UPCOMING EVENT   September 4-5, 2024 (2 day event) Networking @Scale

Networking @Scale 2024

Networking @Scale is a technical conference for engineers that build and manage large-scale networks. Meta’s Networking Infrastructure team is excited to host Networking @Scale, a two-day virtual event featuring a range of speakers from Meta...
UPCOMING EVENT   October 9, 2024 Reliability @Scale

Reliability @Scale 2024

Reliability @Scale is a technical conference for engineers who are passionate about building and understanding highly resilient and reliable systems and products at massive scale. Whether it’s novel design decisions, or outages that impact billions...
UPCOMING EVENT   October 23, 2024 Mobile @Scale

Mobile @Scale 2024

Mobile @Scale is a technical conference designed for the engineers, product managers, and engineering leaders building mobile experiences at significant scale (millions to billions of daily users). Mobile @Scale provides a rare opportunity to gather...
UPCOMING EVENT   November 20, 2024 Video @Scale

Video @Scale 2024

Video @Scale 2024 is a technical conference designed for engineers that develop or manage large-scale video systems serving millions of people. The development of large-scale video systems includes complex, unprecedented engineering challenges. The @Scale community...
PAST EVENT   March 20, 2024 @ 9am PT - 3pm PT RTC @Scale

RTC @Scale 2024

RTC @Scale is for engineers who develop and manage large-scale real-time communication (RTC) systems serving millions of people. The operations of large-scale RTC systems have always involved complex engineering challenges which continue to attract attention...
Past EVENT   May 22, 2024 Data @Scale

Data @Scale 2024

Data @Scale is a technical conference for engineers who are interested in building, operating, and using data systems at scale. Companies across the industry use data and underlying infrastructure to build products with user empathy,...
Past EVENT   June 12, 2024 Systems @Scale

Systems @Scale 2024

Systems @Scale 2024 is a technical conference intended for engineers that build and manage large-scale distributed systems serving millions or billions of users. The development and operation of such systems often introduces complex, unprecedented engineering...

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy