> Markdown version of [/jobs/ext/197825-data-engineer](https://www.wearedevelopers.com/jobs/ext/197825-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Aptean - **Location:** Alpharetta, GA, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Data Analysis, Microsoft Azure, Code Review, Continuous Integration, Data Validation, Data Dictionary, Information Engineering, Data Governance, Data Systems, Github, Python (Programming Language), Performance Tuning, Power BI, Runbook, SQL Databases, Management of Software Versions, Workflow Management Systems, Data Ingestion, Azure Data Factory, Git, Microsoft Fabric, Data Lakes, Pyspark, Git Flow, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** May 30, 2026 - **Apply:** https://www.disabledperson.com/jobs/72702107-data-engineer ## About the Role Aptean is seeking a hands-on Data Engineer to build, test, and maintain scalable data ingestion and transformation pipelines on Microsoft Fabric. This role is execution-focused and centered on delivering high-quality data solutions that support enterprise reporting, analytics, and AI use cases. The ideal candidate brings experience in modern lakehouse environments and a strong sense of ownership with a willingness to learn., * 3-5 years of experience building data pipelines in production or near-production environments * Hands-on experience with Python and PySpark * Experience with Azure Data Factory or similar orchestration tools * Familiarity with Microsoft Fabric (or strong experience in Azure Synapse/Databricks with willingness to learn Fabric) * Solid understanding of SQL, data modeling, and performance optimization * Knowledge of medallion architecture and Delta Lake concepts * Experience implementing data quality checks and basic SCD handling * Familiarity with Git, branching, and CI/CD practices (Azure DevOps or GitHub Actions) * Exposure to Power BI and semantic data models is a plus * Understanding of data governance concepts such as schema versioning and access controls preferred * Strong problem-solving skills, attention to detail, and ownership mindset * Effective communication skills and ability to collaborate with technical and business teams ## Description As a Data Engineer, you will be responsible for developing and maintaining data pipelines across the medallion architecture (bronze, silver, gold) using Microsoft Fabric and Azure technologies. You'll work closely with senior engineers, analysts, and business stakeholders to translate requirements into reliable, scalable data engineering solutions. This role requires strong hands-on experience with Python, PySpark, and data pipeline orchestration tools, as well as a focus on data quality, performance optimization, and operational excellence., * Build and maintain data ingestion pipelines using Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks) and Azure Data Factory * Develop Python and PySpark notebooks to cleanse, transform, and enrich data across medallion architecture layers * Implement Delta Lake patterns including partitioning, schema evolution, and incremental loads * Apply data quality checks including null handling, duplicate detection, schema validation, and SCD logic * Develop reusable, metadata-driven, and parameterized pipeline frameworks * Troubleshoot pipeline failures, performance issues, and data discrepancies; perform root-cause analysis * Participate in code reviews, testing, and CI/CD processes using Git-based workflows * Support gold-layer datasets and semantic models for Power BI consumption * Monitor pipelines and resolve operational issues within defined SLAs; support on-call rotations as needed * Maintain technical documentation such as data dictionaries, mappings, and runbooks * Collaborate cross-functionally to deliver high-quality data engineering solutions, * Opportunity to work with modern data technologies including Microsoft Fabric and Azure * Collaborative environment with experienced data engineering professionals * Exposure to enterprise-level data, analytics, and AI initiatives * Growth opportunities through hands-on learning and ownership of impactful projects ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)