Skip to main content
Datadog logo
DatadogPosted this weekCompany application

Senior Software Engineer - Incident Insights & Readiness

Boston, Massachusetts, USA, New York, New York, USA, New YorkFull-timePosted 7 days ago0 applicants
On-siteSecurity$21,905 – $240,000
Accepting applications
$21,905 – $240,000/ year
Type
Full-time
Mode
On-site
Level
Open

About the role

  • Datadog named a Leader in the Gartner® Magic Quadrant™ for Observability Platforms Leader in the Gartner® Magic Quadrant™ Careers Welcome Culture Workplace Benefits Candidate
  • Experience Inclusion Learning & Development Pup Culture Blog Teams Engineering General & Administrative Marketing Product
  • Design Product Management Sales Technical Solutions Early Career & Internships Locations Americas Asia Pacific EMEA Remote All Jobs Careers Welcome Culture Workplace Benefits Candidate
  • Experience Inclusion Learning & Development Pup Culture Blog Teams Engineering General & Administrative Marketing Product
  • Design Product Management Sales Technical Solutions Early Career & Internships Locations Americas Asia Pacific EMEA Remote All Jobs Senior Software Engineer - Incident Insights & Readiness Boston, Massachusetts, USA; New York, New York, USA We're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale—trillions of data points per day—providing always-on alerting, metrics visualization, logs, and application tracing for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way The Incident Insights & Readiness SRE team at Datadog fosters a resilient culture by using incidents as learning opportunities and catalysts for growth. Our users are Datadog engineers, and we build the software, tooling, and operational frameworks that help them prepare for, respond to, and learn from incidents. We work closely with engineering teams across Datadog to analyze incidents and turn those insights into better tools, stronger incident response, and organizational learning. Our efforts empower Datadog to navigate unexpected failures confidently, efficiently, and with a commitment to continuous learning and systems improvement. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do

  • Own and improve the on-call experience for the company by establishing best practices and building platforms to support on-call rotations and compensation.
  • Define how we respond to incidents, lead the design and implementation of software to streamline the process, and collaborate with product teams to improve incident response across Datadog. Our aim is to fully support our incident responders in dealing with complexity.
  • Contribute to the post-mortem process for the company, collaborating with teams on writing them, and identifying opportunities to reduce friction and enhance learning value for the organization. Our team also runs a weekly postmortem reading group.
  • Support various teams in facilitating incident reviews that emphasize learning and blamelessness. Help them share their learnings across the organization to improve the resilience of our people.
  • Provide technical leadership and day-to-day coaching to team members, accelerating their growth through design reviews, collaborative problem-solving and operational excellence best practices. Train our on-callers in incident and post-mortem processes, sharing expertise in incident management best practices. This involves both introducing newcomers to on-call responsibilities and refreshing the knowledge of existing engineers.
  • Lead cross-functional initiatives in engineering organizations across Datadog, embedding with teams to understand their challenges and drive lasting improvements to reliability and operational excellence. Who You Are At least 5 years of experience building software that solves real user problems.
  • Experience designing new features and collaborating on code and technical design reviews. We primarily develop in Go and Python, with a bit of TypeScript.
  • Experience building or operating distributed systems, with familiarity with Kubernetes and an understanding of complex failure modes. Demonstrated ability to independently own ambiguous technical problems from design through delivery while balancing long-term engineering quality with pragmatic execution.
  • Experience analyzing incidents, identifying systemic risks, and driving engineering improvements informed by operational learnings.
  • Experience participating in on-call rotations and improving incident response processes.
  • Experience serving as an incident commander or incident coordinator is a plus. Empathy, collaboration, and communication skills in English to cultivate strong relationships across various teams in the organization
  • Experience mentoring engineers, driving cross-functional initiatives, and influencing technical direction without relying on organizational authority. We welcome candidates from a variety of backgrounds, including software engineering, site reliability engineering, production engineering, infrastructure, and other roles focused on building reliable systems or improving incident response. Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. Benefits and Growth New hire stock equity (RSUs) and employee stock purchase plan (ESPP) Continuous professional development, product training, and career pathing Intradepartmental mentor and buddy program for in-house networking An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups) Access to Inclusion Talks, our internal panel discussions Free, global mental health benefits for employees and dependents age 6+ Competitive global benefits Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog. Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan. The reasonably estimated yearly salary for this role at Datadog is $192,000 — $240,000

USD About Datadog

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram , LinkedIn, and Datadog Learning Center.

Equal Opportunity

  • at Datadog Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference. Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form . This form is for accommodation requests only and cannot be used to inquire about the status of applications. Privacy and AI Guidelines Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice . For information on our AI policy, please visit Interviewing at Datadog AI Guidelines . Requisition ID R21905 Product Observability Infrastructure Infrastructure Monitoring Custom Metrics Network Monitoring Container Monitoring Kubernetes Autoscaling Serverless Monitoring Cloud Cost Management Storage Management GPU Monitoring Applications Application Performance Monitoring Universal Service Monitoring Continuous Profiler Dynamic Instrumentation Data Database Monitoring Data Observability Data Streams Monitoring Logs Log Management Audit Trail Observability Pipelines Error Tracking Bring Your Own Cloud Log Management security-platform Security Code Security Code Security Software Composition Analysis Static Code Analysis Runtime Code Analysis IaC Security Secret Scanning Cloud Security Cloud Security Sensitive Data Scanner Cloud Security Posture Management Cloud Infrastructure Entitlement Management Vulnerability Management Compliance Cloud Workload Protection App & API Protection SIEM Cloud SIEM rum Digital
  • Experience Product Analytics Experiments Browser Real User Monitoring Mobile Real User Monitoring Session Replay Synthetic Monitoring Mobile App Testing ci Software Delivery Software Delivery Continuous Testing Internal Developer Portal (IDP) CI Visibility Test Optimization Feature Flags Code Coverage DORA Metrics + AI Impact Service Management Incident Response Incident Management
  • Work Management Actions Workflow Automation Datadog Apps Event Management Context Graph Software Catalog AI AI for Datadog Bits Investigation Bits AI Bits Chat Bits Agent Builder Bits Code Bits Security Analyst Datadog for AI Agent Observability MCP Server Pup CLI dashboard Platform Capabilities Built-in Features Alerts Dashboards Notebooks Mobile App Fleet Automation Access Control Governance Console Teams Extensibility OpenTelemetry Integrations IDE Plugins Agent Directory API Marketplace Service Level Objectives Resources Pricing Documentation
  • Support Services & Enablement Product Preview Program Certification Open Source Events and Webinars Security Privacy Center
  • Knowledge Center Learning Resources Blog The Monitor Engineering AI Security Labs About Contact Us Partners Press Leadership Careers Legal Investor Relations Analyst Reports ESG Report Vendor Help Trust Hub Download mobile app © Datadog 2026 Terms | Privacy | Cookies " width="16px" height="16px" viewBox="0 0 48 48" version="1.1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink"> Icon/world Created with Sketch. English " width="10" height="10" viewBox="0 0 10 10" fill="none" xmlns="http://www.w3.org/2000/svg"> English English 日本語 Japanese 한국어 Korean instagram

Benefits and perks

Candidate Experience
Learning & Development
Pup Culture Blog
General & Administrative
Product Management
Technical Solutions
Ready to apply?

Take the next step.
It takes 90 seconds.

Applications are reviewed directly by the Datadog hiring team. You will be redirected to their careers page.

0applicants so far
Full-timerole type
On-sitework mode

You can return to this role from saved jobs any time.