> Markdown version of [/jobs/ext/1311369-data-engineer-senior](https://www.wearedevelopers.com/jobs/ext/1311369-data-engineer-senior). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Senior - **Company:** BDR Solutions - **Location:** United States - **Experience:** Expert - **Salary:** $110,000.0 - $170,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Database, Data Governance, Data Infrastructure, Data Sharing, Github, Identity and Access Management, Python (Programming Language), Role-Based Access Control, Requirements Traceability, SQL Databases, Data Streaming, Datadog, Azure Data Factory, Amazon Virtual Private Cloud (VPC), Data Lakes, Pyspark, Information Technology, Collibra, Data Analytics, Apache Kafka, Machine Learning Operations, Cloudwatch, Terraform, Splunk, Data Pipelines, Databricks - **Published:** July 17, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9036929/data-engineer-senior ## About the Role BDR Solutions is seeking a seasoned Cloud Data Engineering Lead to support IRS data platform initiatives, focusing on secure, scalable architecture and tenant onboarding within a Databricks and AWS ecosystem. This role leads data governance, workspace design, and end-to-end onboarding processes while ensuring compliance with federal security standards and IRS requirements. The ideal candidate brings strong technical expertise, federal experience, and the ability to partner closely with stakeholders to drive adoption and operational excellence. Responsibilities: * Active MBI - mandatory; candidates in process do NOT qualify * Current or recent IRS contract experience strongly preferred * 8+ years in cloud data engineering; 3-5 years hands-on Databricks (Unity Catalog, Delta Live Tables, Auto Loader, Genie) * Databricks Certified Data Engineer Professional or advanced equivalent - must be current and in good standing at award * AWS Certified Solutions Architect or Data Engineer - Associate or Professional * Deep experience with medallion architecture (Bronze/Silver/Gold), Delta Lake, and CDC patterns * Proficiency in Python, PySpark, and SQL for enterprise pipeline development * Hands-on AWS: S3, IAM, VPC, CloudWatch, Glue, Athena * Experience with RBAC/ABAC, row-level security, PII column masking * Familiarity with IRS OneSDLC, FISMA, NIST 800-53, and FedRAMP High * Bachelor's degree in Computer Science, Information Technology, or related field, * Databricks Ecosystem * Azure DevOps or GitHub Actions * Experience with machine learning pipelines * Knowledge of data governance frameworks * Familiarity with real-time streaming systems * Certifications in cloud platforms (AWS Certified Data Analytics, Azure Data Engineer) In addition, U.S Citizenship is required. Select applicants will be subject to a government security investigation and must meet eligibility requirements for access to classified information and be able to obtain a government-granted security clearance. Individuals may also be subject to a background investigation including, but not limited to criminal history, employment and education verification, drug testing, and creditworthiness. This position is contingent upon contract award. Employment is not guaranteed and will proceed only if the associated contract is awarded and funded. ## Description * Lead workspace architecture, Unity Catalog governance, and cluster policy design for IRS tenant organizations * Perform tenant discovery and requirements gathering, source profiling, and security classification for new data intake requests * Develop end-to-end technical designs for tenant onboarding including Data Sharing Agreements and SLA documentation * Maintain Requirements Traceability Matrix (RTM) and prepare Architecture Review Board (ARB) submissions * Contribute to tenant onboarding automation, financial operations integration, and ROI reporting * Deliver tenant training materials and facilitate weekly office hours for IRS program teams * Support P1/P2 incident response within SLA for tenant-related platform issues * Provide NIST 800-53 control evidence within 5 business days of IRS audit requests * Clearance Required: Minimum Background Investigation (MBI) - ACTIVE Tools and Platforms: * Preferred Tools & Technologies: Terraform, GitHub Actions or Azure DevOps, Kafka/MSK, dbt, Great Expectations, Splunk/Datadog, Collibra/Alation, AWS Lake Formation, and experience with data mesh or modern data product architectures. ## Related Videos - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)