> Markdown version of [/jobs/ext/1497829-data-engineer-w-ai](https://www.wearedevelopers.com/jobs/ext/1497829-data-engineer-w-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer w/ AI

- **Company:** NTH VENTURE, INC
- **Location:** United States (Remote available)
- **Salary:** $197,600.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Airflow, Confluence, Microsoft Azure, Continuous Integration, Data Validation, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Distributed Data Store, Document-Oriented Databases, Github, Python (Programming Language), SQL Azure, Cloud Services, Systems Architecture, Azure Service Bus, Data Processing, Cloud Platform System, Azure Data Factory, Git, Kubernetes, Data Analytics, Data Management, Interactive Whiteboards, Terraform, Azure Synapse Analytics, Software Version Control, Data Pipelines, Docker, Databricks
- **Published:** July 30, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=f008cacbb3c81bd5

## About the Role

* Claude usage
 * Strong proficiency in Python for data engineering use cases
 * Hands-on experience with Apache Airflow for workflow orchestration
 * Practical knowledge of Polars for data processing and transformation
 * Solid experience building and running Docker containers
 * Experience working in Microsoft Azure cloud environments
 * Understanding of data modeling and schemas, ETL/ELT patterns, and distributed data systems
 * Experience with Git and collaborative development workflows
 * Strong problem-solving skills and attention to detail, * Experience with Azure data services such as Azure Data Factory, Synapse Analytics, Databricks, or Event Hubs
 * Experience deploying containerized workloads using AKS or similar orchestration platforms
 * Familiarity with CI/CD pipelines for data platforms

## Description

The ideal candidate has strong Python skills, experience orchestrating workflows with Apache Airflow, and hands-on expertise working with modern data libraries such as Polars. You will work extensively with Docker and deploy data solutions in the Microsoft Azure cloud environment. This role will also focus on modernizing the data platform by migrating existing data pipelines from Azure Synapse Analytics to Apache Airflow-based orchestration frameworks., * Use Claude to assist in your delivery

 * Design, develop, and maintain reliable, scalable data pipelines using Python, Polars, and Apache Airflow
 * Maintain Airflow deployments in Docker to ensure portability and consistency across environments
 * Deploy, manage, and monitor data solutions in Azure (e.g. Azure Container Instances, Azure Storage, Azure SQL)
 * Optimize data performance, reliability, and cost in cloud-based architectures
 * Collaborate with analytics, BI, and data science teams to ensure high-quality, well-modeled data
 * Implement data quality checks, monitoring, and alerting
 * Follow best practices for version control, testing, CI/CD, and infrastructure-as-code (e.g., GitHub, Azure DevOps, Azure Artefacts, Azure Container Registry, Terraform)
 * Document data pipelines, system architecture, and operational procedures (Confluence and Miro)


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models)

## Related Articles

- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)