Video @Scale 2021
Share

Optimizing Storage Efficiency for FB Video Processing

Like the rest of the video world, Facebook Video has significantly grown year to year. While we celebrate the growth rate, we are also concerned about the resources consumption to support the growth, which became worse during COVID. Seeing the gap between increased storage demand and supply, video infra has worked with Facebook capacity team to invent new methods to bend the curve. We establish source + MVE (minimum variable encoding) storage policy for every FB video. Then through a video lifecycle manage system, we ensure the storage consumption of a video is proportional to its popularity. For example, purge un-used encodings, and reduce source from two permanent copies to one copy if the video becomes “cold”. With such technology, 70% of FB Video projected storage growth for 2021 has been successfully suppressed. We are exploring to further improve the performance and accuracy of the storage management system with cost-benefit model.

Related Topics

Join the @Scale Mailing List and Get the Latest News & Event Info

Code of Conduct

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy