Product @Scale 2024

August 14, 2024

Product @Scale conferences are designed for technologists who work on solving complex product problems at scale. The @Scale community focuses on bringing forward people's experiences in creating innovative solutions to large-scale products serving millions or even billions of creators, people, and businesses involving complex product and business tradeoffs and challenging engineering problems to overcome.

Product @Scale 2024 will be hosted virtually by Meta. Joining us are eminent speakers from Google, Fireworks.AI, Roblox, Microsoft, and AI experts from across Meta, who will be sharing their unique perspectives. The event will showcase a keynote address by Rajesh Nishtala, Distinguished Software Infrastructure Engineer at Meta. The conference will also feature talks themed around the latest advances in AI and how they are being utilized to build Products, the challenges of building products at scale using AI Tech, and how AI is changing the way we use and interact with Products.

Register today and check back for upcoming speaker and agenda announcements!

RSVPS CLOSED
AGENDA SPEAKERS

EVENT AGENDA

Event times below are displayed in PT.

August 14

09:30 AM - 09:35 AM
Opening Remarks
Speaker Sreeram Chakrovorthy,META
09:35 AM - 09:55 AM
AI Infrastructure @Meta

Keynote presentation

Speaker Rajesh Nishtala,Meta
09:55 AM - 10:15 AM
Azure AI Studio

Custom copilots are evolving from simple LLM+data retrieval augmented generation (RAG) solutions into more complex solutions with multiple interoperating APIs, models, metaprompts and grounding data. In this session, we’ll talk about these emerging patterns and show how Azure AI Studio empowers developers to build multi-agent copilot solutions. Discover advanced features such as debugging tools and security measures for developing intelligent, scalable, and safe AI solutions.

Speaker Nabila Babar,Microsoft
10:15 AM - 10:35 AM
Shipping Faster: Behind the Scenes of How We Built Meta.AI
Speaker Kathryn Middleton,META
Speaker Chris Li,META
10:35 AM - 10:40 AM
Break
10:40 AM - 11:00 AM
Experience Creation at Scale Leveraging AI

The talk will start introducing Roblox and the content creation journey of creators who build experience on the Roblox platform. AI is fundamentally changing the process of creation and is disrupting content creation workflows that need to be re-imagine from the ground up. The talk will go through some of the approaches, key findings and strategic bets in the Generative AI space, as well as future challenges ahead.

Speaker Stef Corazza,Roblox
11:00 AM - 11:20 AM
The Next Generation of AI, All on Your Phone: On-Device Model Development at Instagram

While in today’s AI landscape bigger seems to always be better, there is a burgeoning field on the other end of the spectrum. This talk will cover the basics of on-device AI model development and product applications of this technology at Instagram.

Speaker Avni Kakkar,META
11:20 AM - 11:40 AM
Fireworks AI: Go from Hype to High-Value AI

In AI development, moving from hype to high-value means optimizing base models into specialized versions. This presentation shows the benefits of smaller, focused models that outperform proprietary mega-models ones in latency, throughput, and cost-efficiency. Learn practical methods, real-world examples, and best practices for moving from prototype to production. Discover how Fireworks AI helps developers go from idea to application with the fastest and most efficient inference platform. Additionally, explore how AI developers are creating compound AI systems, combining multiple models and components to tackle the most challenging AI tasks.

Speaker Lin Qiao,Fireworks AI
11:40 PM - 12:00 PM
Meta Capacity Planning for AI Training Hardware
Speaker Rahul Rai,META
Speaker Genevieve Ho,META
Featured Article
Meta Capacity Planning for AI Training Hardware  read more
12:00 PM - 12:20 PM
Fireside Chat
Moderator Joseph Laria,Meta
Speaker Khushboo Taneja,META
12:20 PM - 01:20 PM
Lunch
01:20 PM - 01:40 PM
Confidently Building Social Connection: How Write with AI on Facebook Support User Generated Content

Facebook's new tool, Write with AI, is designed to enhance user-generated content by helping users overcome common writing challenges like writer's block and tone misalignment. Leveraging the advanced LLaMa3 model, the tool offers real-time editing suggestions and personalized responses to user prompts, significantly improving the clarity and engagement of social media posts. Since its launch, Write with AI has increased the overall share rate of posts, indicating a substantial improvement in user satisfaction. The tool is set to expand further, incorporating features like auto-completion and contextually rich photo captions (LlaMa3-multimodal), aiming to transform digital communication on Facebook by making it more personal and expressive.

Speaker Joena Zhang,META
Featured Article
Confidently Building Social Connections  read more
01:40 PM - 02:00 PM
Talking to Others for You: Leveraging Machines that Speak the “Human Conversation” Protocol

In recent years it’s become much easier to talk to machines freely. But rather than talking to machines ourselves, can we have machines talk to others for us? Communication (e.g. phone calls) is an API to the real world. By teaching machines this “protocol of human conversation” we can tap into any service built for humans with instant deployment at zero integration work by any remote party, creating value for both sides. Of course, doing this at scale in consistently high quality and guaranteeing safety and privacy remains challenging. In this talk we bring several tips and advice from having deployed the technology called Google Duplex to several such applications in production, at scale.

Speaker Yoav Tzur,Google
02:00 PM - 02:20 PM
AI Generated Animation and Video: A Look at the Industry and Meta

Learn about the history of generative AI media products in the industry and at Meta itself. We'll deep dive into the various challenges of scale we had to overcome to serve millions of people, along with some of the novel optimizations to make our animation model one of the fastest in the industry.

Speaker Gaurav Sharma,META
02:20 PM - 02:40 PM
Q&A
Moderator Joseph Laria,Meta
Speaker Lin Qiao,Fireworks AI
Speaker Stef Corazza,Roblox
Speaker Kathryn Middleton,META
Speaker Chris Li,META
Speaker Rajesh Nishtala,Meta
02:40 PM - 02:45 PM
Closing Remarks
Speaker Sreeram Chakrovorthy,META

SPEAKERS AND MODERATORS

Sreeram Chakrovorthy

META

Rajesh is a 14 year veteran of Meta and is currently a senior TL... read more

Rajesh Nishtala

Meta

Nabila Babar Principal PM Manager at AI Platform, Microsoft, and a dynamic leader in... read more

Nabila Babar

Microsoft

Kathryn Middleton is a Software Engineer on Meta AI with 10+ years of engineering... read more

Kathryn Middleton

META

Chris is a full-stack software engineer at Meta who develops GenAI products. In his... read more

Chris Li

META

Formerly a Stanford Researcher, Stef is the founder (and former CTO/CEO) of Mixamo, the... read more

Stef Corazza

Roblox

Avni Kakkar is the PM for the Computer Vision / Machine Learning team at... read more

Avni Kakkar

META

Lin is the CEO and co-founder of Fireworks AI, with the mission to accelerate... read more

Lin Qiao

Fireworks AI

Product Manager at Meta. I drive product strategy and roadmap for all our internal... read more

Rahul Rai

META

Genevieve Ho is a Product Manager at Meta currently working with the budgeting and... read more

Genevieve Ho

META

Joseph is a Technical Product Manager in Meta's Core Recommendations Systems organization. He is... read more

Joseph Laria

Meta

Khushboo Taneja

META

Research Scientist, Computer Science Phd, GenAI product expert. read more

Joena Zhang

META

Since joining Google in 2009, Yoav has enjoyed spending most of his time building... read more

Yoav Tzur

Google

Software Engineer at Meta on the Generative AI team working on generative media: music,... read more

Gaurav Sharma

META

LATEST NOTES

Product @Scale
08/14/2024
Confidently Building Social Connections
How Write with AI on Facebook Supports User-Generated Content In the digital era, social media platforms such as Facebook have...
Product @Scale
08/22/2024
Meta Capacity Planning for AI Training Hardware
At Meta, we manage a planetary-scale AI training fleet comprising thousands of GPUs used for training a variety of models...
UPCOMING EVENT   May 22, 2024 | Data @Scale

Data @Scale 2024

Data @Scale is a technical conference for engineers who are interested in building, operating, and using data systems at scale. Companies across the industry use data and underlying infrastructure to build products with user empathy,...

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy