Sr Data Engineer

Dynatrace LLC
Boston, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 155K

Job location

Boston, United States of America

Tech stack

Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Application Release Automation
ARM
Automation of Tests
Software as a Service
Cloud Computing
Continuous Integration
Data Validation
Information Engineering
Data Infrastructure
ETL
Data Sharing
DevOps
Github
Python
Metadata
Open Source Technology
Product Management
Query Optimization
Role-Based Access Control
Delivery Pipeline
Snowflake
Spark
GIT
Gitlab-ci
Kafka
Terraform
Software Version Control
User Administration

Job description

  • ETL / ELT Pipeline Automation: Build and operate scalable ELT/ETL pipelines using open-source tools (Python, Spark, etc) and managed platforms such as Fivetran, etc, applying automation-first patterns to minimize per-source engineering effort. Own the dbt project end-to-end - model layering, testing, deployment, and lineage - and instrument pipelines with data quality checks, SLA alerting, and CI/CD practices.
  • Platform Administration & Operations: Administer Data platform tools such as Snowflake, AWS Services, DBT Cloud across all environments, warehouse sizing, query optimization, object lifecycle, RBAC design, and Row-Level Security implementation with access provisioning automated through scripting or infrastructure-as-code. Own alerting and notification automation for pipeline health, data quality breaches, and cost spikes, and provide operational support and administration. May need to participate in On-Call rotations., * A one-product software company creating real value for the largest enterprises and millions of end customers globally, striving for a world where software works perfectly.
  • Working with the latest technologies and at the forefront of innovation in tech on scale; but also, in other areas like marketing, design, or research.
  • A team that thinks outside the box, welcomes unconventional ideas, and pushes boundaries.
  • An environment that fosters innovation, enables creative collaboration, and allows you to grow.
  • A globally unique and tailor-made career development program recognizing your potential, promoting your strengths, and supporting you in achieving your career goals.
  • A truly international mindset that is being shaped by the diverse personalities, expertise, and backgrounds of our global team.
  • A relocation team that is eager to help you start your journey to a new country, always there to support and by your side.
  • Attractive compensation packages and stock purchase options with numerous benefits and advantages.

Requirements

  • 6+ years of data engineering experience with senior-level ownership of pipelines and ingestion systems.

Preferred Requirements:

  • Hands-on experience with open-source orchestration tools - Python, Apache Airflow, Spark, Kafka, or equivalent.
  • Experience operating Fivetran, dbt - connector configuration, schema drift handling, and sync management.
  • Experience building ingestion automation frameworks using metadata-driven or configuration-driven patterns.
  • Hands-on Snowflake administration - virtual warehouse sizing, query tuning, clustering keys, object lifecycle management, and credit cost governance.
  • Snowflake feature administration including Streams, Tasks, Dynamic Tables, Snowpipe, and Data Sharing.
  • Platform-level administration of managed ELT tools such as Fivetran or Matillion - user management, connector governance, environment configuration, and operational support.
  • Hands-on dbt administration: project configuration, environment and job management, dbt Cloud/Core deployment, and model promotion workflows.
  • DevOps & Release Automation / Monitoring:
  • Experience owning end-to-end alerting and notification automation for pipeline failures, data quality breaches, SLA violations, and platform cost anomalies.
  • Experience applying DevOps practices to data infrastructure, Git-based version control, CI/CD pipelines (GitHub Actions, GitLab CI, or equivalent), and automated testing for dbt models and pipeline code.
  • Infrastructure-as-code experience (Terraform or equivalent) for provisioning Snowflake objects, roles, and warehouses in a repeatable, auditable way.
  • Ability to manage release workflows across dev / staging / prod environments with automated promotion gates and rollback capability.
  • Experience with Snowflake AI integrations
  • Snowflake SnowPro Core, Advanced, or Cortex AI certification
  • Experience with dbt Mesh or cross-project dbt architectures at scale
  • Background in SaaS industries

Benefits & conditions

DOE, salary $125K - $155K, plus Health, Dental, Life, STD, LTD, 401K, PTO. Total compensation may vary depending on candidate experience/education and location.

Apply for this position