Software Engineer - Data & Analytics Governance
Role details
Job location
Tech stack
Job description
At Datadog, we process millions of monitors every minute, alerting our customers when configured thresholds are crossed. Engineers across the world trust us to alert them when necessary, so our Alerting stack needs to be reliable and scalable.
Data is at the heart of our decision-making. Our Data & Analytics Governance team is responsible for managing our Data Catalog, which tracks millions of data assets and their metadata, supports event-driven pipelines, and ensures compliance at scale. This platform empowers our engineers to build reliable pipelines and our analysts to make data-driven decisions confidently.
The Data Catalog sees high usage, handling 800 requests per second and tracking 16M new assets monthly, driving critical workflows across Datadog. Our team is building the next generation of tools to optimize this platform, tackle performance challenges, and enable new customer-facing use cases.
Weâre looking for a Software Engineer to help us expand the capabilities of our Data Catalog and scale our data governance tools.
At Datadog, we place value in our office cultureâthe relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What Youâll Do:
- Build and maintain high-performance backend services for the Data Catalog, enabling data processing pipelines, data discovery, and observability.
- Work with engineering and analytics teams to understand their needs, ensure compliance, and provide tools that empower them to make data-driven decisions.
- Solve performance and scale challenges, such as sharding storage to handle growing demand and optimizing our Python/Go clients and UI.
- Contribute to large-scale projects like standardizing schemas across Datadog applications, improving navigation, detecting breaking changes, and powering customer-facing products.
- Automate compliance tagging (e.g., PII/SOX) and develop tools for consistent data access management across platforms like Snowflake, S3, and Metabase.
- Collaborate with a distributed team to deliver quarterly projects, participating in light Scrum processes with regular checkpoints and biweekly planning sessions.
Requirements
- Experienced in API/backend development (we use Golang but welcome experience in other languages).
- Knowledgeable about operating highly available applications, including deterministic rollouts and fallback strategies.
- Familiar with Data Engineering concepts and tools, enabling effective collaboration with stakeholders.
- Comfortable working with or learning technologies like Python, Postgres, Kafka, Kubernetes, and Spark.
- Passionate about enabling governance at scale and building platforms that support performance and usability for diverse use cases.
Bonus points for:
- Experience with access management, React UI development, Iceberg, or Trino.
- An interest in solving large-scale challenges like schema standardization and compliance automation.
Benefits & conditions
- New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
- Continuous professional development, product training, and career pathing
- Intradepartmental mentor and buddy program for in-house networking
- An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)
- Access to Inclusion Talks, our internal panel discussions
- Free, global mental health benefits for employees and dependents age 6+
- Competitive global benefits
Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.