Every day, Datadog runs massive data pipelines to power core functionality.
In this talk, Staff Data Engineer Jeremy Karn covers best practices at Datadog to ensure that the company reliably delivers this functionality while processing trillions of points/day in the face of exponential data growth, hardware failures, corrupt data, and even human error.