In the process of building a monitoring and analytics platform that ingests trillions of data points a day, Datadog has learned many lessons about scalable, distributed systems in the cloud. We'd like to share those experiences with our community in this series: "Datadog on..."
Each episode will offer a conversation with the engineers who build Datadog. They'll share real-world experiences architecting, building, operating, and monitoring modern systems giving you actionable information you can apply at your organization. With plenty of time left for Q&A, we'd like you to join the discussion.
Datadog on Data Engineering Pipelines: Apache Spark at Scale
March 23, 2023
Alodie Boissonnet, Anton Ippolitov and Ara Pulido
Datadog is an observability and security platform that ingests and processes tens of trillions of data points per day, coming from more than 22,000 customers. Processing that amount of data in a reasonable time stretches the limits of well known data engines like Apache Spark.
Datadog on the Lifecycle of Threats and Vulnerabilities
January 12, 2023
Nick Frichette, Adam Stevko and Andrew Krug
Datadog on Building an Event Storage System
December 13, 2022
Ara Pulido, Guillaume Duranceau and Ryan Worl
Datadog on gRPC
September 29, 2022
Ara Pulido, Anthonin Bonnefoy and Antoine Tollenaere
Head of Security Advocacy
Software Engineer, Threat Detection
Senior Software Engineer, Data Engineering Infrastructure
Software Engineer, Historical Metrics Query