> Markdown version of [/jobs/ext/2998792-data-engineer-airflow-dbt-kubernetes-openshift](https://www.wearedevelopers.com/jobs/ext/2998792-data-engineer-airflow-dbt-kubernetes-openshift). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Airflow, dbt, Kubernetes/OpenShift - **Company:** Conch Technologies - **Location:** Jersey City, NJ, United States - **Experience:** Expert - **Contract:** Temporary to permanent - **Skills:** Artificial Intelligence, Airflow, Data Analysis, Continuous Integration, Information Engineering, Fault Tolerance, Python (Programming Language), OpenShift, Oracle Warehouse Builder, Performance Tuning, Cloud Services, SQL Databases, Enterprise Data Management, Data Processing, Enterprise Software Applications, Macros, Sql Optimization, Autoscaling, System Availability, Git, Containerization, Kubernetes, Performance Monitor, Data Management, Data Pipelines - **Published:** September 19, 2026 - **Apply:** https://www.careerjet.com/jobad/us5f4ddba13cf342f8283c9f69945b8d83 ## About the Role * 10+ years of Data Engineering, Analytics Engineering, or Platform Engineering experience. * Expert-level Apache Airflow DAG development, orchestration, scheduling, and performance tuning. * Expert-level dbt Core modeling, testing, macros, implementation, and optimization. * Strong Python and advanced SQL skills. * Deep production experience with Kubernetes and/or OpenShift. * Strong understanding of distributed workload management and performance optimization. * Experience with cloud data platforms, containerized deployments, CI/CD, Git, and enterprise production environments. Preferred Qualifications * Financial services or accounting platform experience. * Enterprise system migration experience. * Experience with Oracle data warehouses. * Experience supporting high-volume data processing and regulatory reporting. Must-Haves * Expert Apache Airflow / DAG development and performance tuning. * Expert dbt Core / data modeling / testing / implementation. * Strong Python + SQL. * Production Kubernetes/OpenShift experience. * Enterprise-scale data engineering and distributed workload optimization experience., We are seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise data engineering, including deep expertise in Apache Airflow DAG development… + 15 hours ago, We are seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise data engineering, including deep expertise in Apache Airflow DAG development… + 16 hours ago ## Description We are seeking a highly skilled Data Engineer with strong enterprise data engineering experience and deep expertise in Apache Airflow, dbt Core, Python, Kubernetes/OpenShift, and SQL. The role will focus on building, operating, and optimizing scalable data pipelines supporting financial, accounting, migration, and high-volume data processing workloads. Key Responsibilities * Design, develop, and maintain complex Apache Airflow DAGs for batch and event-driven pipelines. * Optimize Airflow scheduling, executors, workers, dependencies, retries, SLAs, and alerting. * Lead dbt Core implementation, including data modeling, testing, documentation, macros, incremental models, and CI/CD. * Develop staging, intermediate, and mart data models following analytics engineering best practices. * Deploy and manage data workloads on Kubernetes/OpenShift. * Implement workload distribution, horizontal scaling, resource optimization, and autoscaling. * Monitor and tune pipeline performance across Airflow, dbt, data platforms, and infrastructure. * Implement observability through logs, metrics, alerts, and proactive monitoring. * Ensure high availability, fault tolerance, security, and resiliency. * Collaborate with data architects, platform engineers, and business stakeholders. * Support financial reporting, accounting, regulatory data, and enterprise migration initiatives., Senior Staff Engineer, AI Compute (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been … + 2 days ago ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Modularity: Let's dig deeper](https://www.wearedevelopers.com/videos/1200-modularity-let-s-dig-deeper) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [DevOps Engineer Salary [2023]](https://www.wearedevelopers.com/magazine/203-devops-engineer-salary-2023) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)