August 14, 2024

Bringing Llama 3 to Life – LlaMa Training at Scale

Topic: Data, Machine Learning and AI
Kaushik Veeraraghavan
Meta

TYPE: Videos

YEAR: 2024

Large scale training requires substantial investment across the infrastructure stack. In this talk, we delve into some of the data center, network and software investments that enabled the development of our Llama3 models.


SUBSCRIBE TO @SCALE

← Back

Thank you for your response. ✨

RECENT POSTS
Transparent Multi-NIC Routing for Large AI Models Fast Solutions, Lasting Impact  Eliminating the Awkward Pause: Ultra-Low Latency Connect (ULLC)
RELATED POSTS
Advancing AI Wearables: The Technical Journey of Ray-Ban Meta Large-Scale Data Graph: Scale Offline Privacy & Security Meet a Keynote Speaker: Clément Farabet, VP of AI Infrastructure, NVIDIA

FINDING SOLUTIONS

We welcome your comments and questions about @Scale. Please contact us through our Facebook page!

TERMS OF USE PRIVACY POLICY COMMUNITY STANDARDS

2026 @SCALE. ALL RIGHTS RESERVED

JOIN THE @SCALE MAILING LIST AND GET THE LATEST NEWS & EVENT INFO

← Back

Thank you for your response. ✨

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy