Bringing Llama 3 to Life – LlaMa Training at Scale

Kaushik Veeraraghavan
Meta

TOPIC:  Machine Learning and AI

@SCALE SERIES:  AI Infra @Scale

TYPE: video

YEAR: 2024

TAGS: 

Large scale training requires substantial investment across the infrastructure stack. In this talk, we delve into some of the data center, network and software investments that enabled the development of our Llama3 models.


SUBSCRIBE TO @SCALE

RECENT POSTS
Pioneering AI Efficiency: Efficient Segmentation Models On-Device Video Playback Upsampling Movie Gen: A Cast of Media-Generation Foundation Models
RELATED POSTS
Meet a Keynote Speaker: Clément Farabet, VP of AI Infrastructure, NVIDIA

FINDING SOLUTIONS

We welcome your comments and questions about @Scale. Please contact us through our Facebook page!

TERMS OF USE PRIVACY POLICY COMMUNITY STANDARDS

2024 @SCALE. ALL RIGHTS RESERVED

JOIN THE @SCALE MAILING LIST AND GET THE LATEST NEWS & EVENT INFO

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy