Senior Software Engineer - Alerting Platform Automation

Job description

At Datadog, we process millions of monitors every minute, alerting our customers when configured thresholds are crossed. Engineers across the world trust us to alert them when necessary, so our Alerting stack needs to be reliable and scalable. The Alerting Platform Automation team’s main goal is to improve the processes and tooling that let our Alerting developers operate the platform efficiently. We design and operate automation systems that replace manual actions, from creating environments to deploying and testing safely. We build test environments that give engineers and their AI coding tools fast, reliable feedback, so changes can be validated in minutes rather than days. Our team is looking for a Senior Software Engineer to help us maintain and scale the Alerting platform. In this position, you’ll work daily with our users, understanding their needs, defining solutions, building the necessary tooling and communicating with all our stakeholders appropriately. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: • Build automation systems that create and manage Alerting environments, with a focus on fast, realistic test environments that shorten the feedback loop for engineers and AI-assisted development workflows. • Work with SRE, Core Infrastructure and the Alerting engineering teams to understand their needs and provide solutions. • Lead infrastructure projects and improve our CI/CD and developer tooling, including our deployment process. • Identify reliability bottlenecks, then design solutions to mitigate or eliminate them, including load testing and testing of infrastructure configuration before it reaches production. • Improve infrastructure isolation and make our services scale automatically with load. Who You Are: • You’re interested in ops and infrastructure challenges, and you’re comfortable writing the code that automates them. • You can analyze a problem, identify its root cause and propose short-term and long-term solutions. • You’re a team player, able to work easily with your team members and with many other development teams. • You communicate appropriately to your audience, from fellow devs to top management. • You work autonomously across multiple technologies owned by different teams, and you like to discover and learn new ones. • You think that infrastructure and code are equally important. • You’re curious about how AI-assisted development changes the way we build and test software, and you enjoy making tooling that works well for both humans and agents. Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That’s okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth: • New hire stock equity (RSUs) and employee stock purchase plan (ESPP). • Continuous professional development, product training, and career pathing. • Intradepartmental mentor and buddy program for in-house networking. • An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups). • Access to Inclusion Talks, our Internal panel discussions. • Free, global mental health benefits for employees and dependents age 6+. • Competitive global benefits. Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. #LI-Hybrid About Datadog: Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to