DevOps Engineer - Data Engineering

We’re building out the data engineering practice supporting a federal healthcare analytics platform, and we need a hands-on DevOps engineer to help us design our CI/CD foundation from the ground up. Today, our data engineers are building pipelines in Azure Data Factory and Databricks, with source code in GitHub, but the deployment, automation, rollback, and monitoring story is largely greenfield. That’s where you come in.

This is not a maintenance role on a mature platform. You’ll be defining how code gets from a developer’s branch to production, what happens when a pipeline fails at 2 AM, and how we keep our environments consistent as the team grows. You’ll have real influence on the standards, tools, and patterns we adopt. If you like solving problems and building systems that aren’t there yet, you’ll have plenty of room to run.

What you’ll do

• Design and implement CI/CD pipelines for Azure Data Factory and Databricks using GitHub Actions, including: PR validation, environment promotion (Dev * Test * Prod), and rollback paths.
• Establish source control conventions: branching, code review, versioning, and the workflows that let multiple data engineers ship without stepping on each other.
• Build the monitoring, alerting, and logging that lets the team detect failures quickly and recover cleanly so a failed pipeline doesn’t corrupt downstream data.
• Help manage and optimize the Azure infrastructure underneath the platform; ADLS, Key Vault, networking, access applying healthcare-appropriate security practices throughout.
• Partner with the data engineering team day-to-day, coaching them on practices and patterns as you put them in place. You’re the DevOps voice on a small team that doesn’t have one yet.
• Document what you build so it survives you. Runbooks, architecture notes, onboarding docs, all part of the job.

The stack today

• Data engineering: Azure Data Factory, Azure Databricks, SQL, Azure Data Lake Storage
• Source control: GitHub (with GitHub Actions available)
• Sources we ingest from: MongoDB, Oracle, SQL Server, on-prem and cloud (AWS) systems, plus patient-generated health data
• Cloud: Azure (primary)

CI/CD pipelines, automated testing, and centralized monitoring are largely greenfield. you’ll be designing them, not inheriting them.

Do you have experience in Version control?, Do you have a Bachelor’s degree?, These are the things we actually need on day one:

• 3-6 years of DevOps, platform, or cloud engineering experience, with meaningful hands-on time in Azure.
• Experience designing and implementing CI/CD pipelines, ideally with GitHub Actions, but Azure DevOps, Jenkins, or similar is fine if you can speak to the patterns.
• Comfort with at least one of Azure Data Factory or Databricks. If you have both, even better; if you have one and a willingness to learn the other quickly, that works.
• Solid Git fundamentals: branching strategies, PR workflows, release management.
• Working knowledge of Azure security basics: Key Vault, RBAC, managed identities, and the principle of “no credentials in source control, ever.”
• A bias toward automation and a problem-solving mindset. Much of this role is figuring out the right way to do something nobody on the team has done before.
• Clear written and verbal communication, you’ll be working with data engineers, analysts, and program stakeholders who don’t all share your vocabulary.

Nice to have (not required)

• Prior experience in federal healthcare, VA, or other regulated environments, or familiarity with HIPAA-style data handling.
• Power BI Deployment Pipelines, dataset refresh orchestration, or Power BI service administration. Power BI is part of our analytics stack; CI/CD around it is on the roadmap but not the immediate priority.
• Infrastructure-as-code experience (Terraform, Bicep, or ARM templates).
• Data quality / testing frameworks like Great Expectations or dbt tests.
• Familiarity with Delta Lake, Unity Catalog, or the medallion (Bronze/Silver/Gold) architecture.
• Microsoft certifications (AZ-400, AZ-104, DP-203) - useful, but we’re hiring on capability, not credentials., * This position works directly with US government contracts and under Order 11935, it requires either U.S. Citizenship or valid Green Card. Please answer 2 if you are a US citizen, 1 if you have a valid green card, 0 if neither. Please make sure to answer this question.
• Your LinkedIn profile link (required):

Education:

• Bachelor’s (Required)

Experience:

• Databricks SQL Warehousing, Delta Lake, and Unity Catalog: 3 years (Preferred)
• Azure Data Factory CI/CD : 3 years (Required)
• DevOps/Cloud/Data Engineering: 3 years (Required)

United States Remote From $125,000 a year - Full-time, Pulled from the full job description

• Referral program
• 401(k)
• Health insurance
• 401(k) matching
• Paid time off
• Vision insurance
• Dental insurance, * 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Paid time off
• Referral program
• Vision insurance