> Markdown version of [/jobs/ext/2702933-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2702933-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Intersources Inc. - **Location:** Washington, DC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Microsoft Azure, Cloud Computing, Cloud Engineering, Continuous Integration, Data Validation, Data Governance, Extract Transform Load (ETL), Data Masking, Data Warehousing, DevOps, Team Foundation Server, Software Deployment, SQL Databases, SQL Server Reporting Services, SQL Server Integration Services, Data Processing, Azure Data Factory, Git, Pyspark, Git Flow, Information Technology, Code Restructuring, Azure Synapse Analytics, Software Version Control, Serverless Computing, Ssas Tabular, Databricks - **Published:** September 4, 2026 - **Apply:** https://www2.jobdiva.com/portal/?a=62jdnw10t7d77ytz0lbaey9qxonk3b05a9tqw96rb7z6hlfo7xj79l9g6mp6aj2o&compid=0/jobs/31821482#/jobs/31821482 ## About the Role Bachelor's degree in Information Technology or related field or equivalent experience Training or certification in a particular product or IT platform/service, as required ## Description The Senior Data Engineer serves as the primary technical engine for the agency's Medicaid data ecosystem. This role is unique: it requires a high-level mastery of our current legacy environment-characterized by SSIS ETL processes managed via Team Foundation Server (TFS)-while actively spearheading the execution of our cloud modernization roadmap. Under the direction of the Lead Data Warehouse Solution Architect, you will ensure the stability of current Medicaid reporting while building the future-state Azure Synapse and Databricks Lakehouse., A. Legacy Maintenance & Operational Excellence (Current State) * ETL Management: Maintain, troubleshoot, and modify complex SSIS packages handling high-volume Medicaid claims, provider, and member data. * Version Control: Manage code deployments and branching strategies within TFS, ensuring continuous integration of legacy SQL assets. * Legacy Reporting Support: Support and optimize SSRS report queries and SSAS tabular/multidimensional models to ensure federal and state compliance reporting remains uninterrupted. B. Modernization & Migration Execution (Future State) * Cloud Development: Implement "Medallion Architecture " (Bronze/Silver/Gold) using Azure Databricks (PySpark/SQL) as designed by the Lead Architect. * Pipeline Refactoring: Lead the transition of legacy SSIS logic into Azure Data Factory (ADF) and Databricks notebooks. * DevOps Transformation: Facilitate the migration of source control and CI/CD pipelines from TFS to Azure DevOps (Git). * Synapse Integration: Build and tune Dedicated and Serverless SQL Pools within Azure Synapse to facilitate advanced analytics and AI-readiness. C. Data Governance & Security * Medicaid Compliance: Implement Row-Level Security (RLS) and automated data masking for PHI/PII in accordance with HIPAA, CMS MARS-E, and NIST standards. * Data Quality: Develop automated data validation frameworks to ensure data parity between legacy SQL systems and the new Cloud Lakehouse. 3. Competencies for Success * Technical Agility: The ability to pivot between a 10-year-old SSIS package and a modern Databricks Spark job in the same day. * Collaboration: Ability to take high-level architectural blueprints from the Lead Architect and translate them into high-performance, production-ready code. * Attention to Detail: Absolute precision in Medicaid data handling, where an error in logic can impact member benefits or federal funding., 1. Leads the adoption or implementation of an advanced technology or platform. 2. Expert on the functionality or usage of a particular system, platform, or technology product. 3. Serves as a consultant to clients, guiding the efficient use or adoption of a particular IT product or platform. 4. Creates implementation, testing, and/or integration plans. 5. Demonstrates expertise in a particular IT platform or service, allowing for maximum IT investment. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)