Facebook’s disaggregated storage and compute for Map/Reduce

To wrap up this year’s Data @Scale, we returned to a classic systems engineering talk. Kestutis Patiejunas and Amisha Jaiswal from Facebook argued that disaggregation of storage and compute provides efficiency through gains in flexibility, latency, and availability by using RS encoding of data warehouse data. As part of the talk, they described warm storage, a new storage system that recently was deployed at Facebook. There was a lively discussion at the end of the talk about purpose-built hardware designs optimized for specific workloads versus generic one-size-fits-all.

To help personalize content, tailor and measure ads, and provide a safer experience, we use cookies. By clicking or navigating the site, you agree to allow our collection of information on and off Facebook through cookies. Learn more, including about available controls: Cookies Policy