> Markdown version of [/jobs/ext/2181656-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2181656-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Blu Omega - **Location:** Ashburn, VA, United States (Remote available) - **Experience:** Expert - **Salary:** $130,000.0 - $160,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Amazon Web Services, Automation of Tests, Microsoft Azure, Cloud Computing, Continuous Delivery, Continuous Integration, Data as a Services, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Transformation, Data Systems, Database Development, DevOps, Distributed Computing Environment, Python (Programming Language), Performance Tuning, Cloud Services, DataOps, SQL Databases, Workflow Management Systems, Enterprise Data Management, Azure Data Factory, Large Language Models, Generative AI, Containerization, Data Lakes, Pyspark, Data Management, Software Version Control, Data Pipelines, Serverless Computing, Databricks - **Published:** August 22, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9110636/senior-data-engineer ## About the Role Clearance: Ability to obtain and maintain a Public Trust suitability determination, * 5+ years of experience with PySpark, SQL, distributed data processing, and enterprise data engineering. * 5+ years of experience designing and maintaining end-to-end data pipelines. * 5+ years of experience with data architecture, including schema design, medallion architecture, and optimization. * 2+ years of hands-on Databricks experience, including Delta Lake, Unity Catalog, and orchestration tools. * 2+ years of cloud platform experience, including Azure Data Factory, Azure Functions, and Azure Storage, or equivalent AWS/GCP services. * Hands-on experience with Palantir Foundry, focusing on pipeline development and data modeling. * Strong skills in Python, PySpark, and SQL development. * Proven ability to lead technical deliverables and mentor team members. * Excellent analytical, troubleshooting, and performance tuning skills. * Effective communication skills for diverse audiences. * Ability to obtain and maintain a Public Trust or Suitability/Fitness determination. * Bachelor's degree in a related field. Preferred Qualifications * Experience implementing CI/CD pipelines using Azure DevOps or similar tools. * Knowledge of generative AI technologies, including LLMs, RAG, and embeddings. * Development or support of AI-driven solutions. * Familiarity with data quality, observability, monitoring, security, and enterprise data governance practices. * Experience supporting federal healthcare, public health, or mission-driven data environments. * Experience leading data platform modernization or migration initiatives. * Knowledge of Agile, DevOps, and DataOps methodologies. ## Description Blu Omega is seeking a Senior Data Engineer to support a federal program focused on public health analytics. This role operates within a remote environment and is responsible for designing, building, and operating enterprise-scale data platforms and pipelines supporting mission-critical health data initiatives. The position requires experience supporting data engineering and cloud data platforms within a mission-driven environment., * Design, build, and maintain enterprise-scale data pipelines and platform components using Databricks, Palantir Foundry, and cloud-native technologies. * Architect robust data solutions through schema design, medallion architecture, partitioning, and distributed processing. * Develop and optimize data transformations with PySpark, Python, and SQL to enhance pipeline reliability and performance. * Build and operate Databricks solutions utilizing Delta Lake, Unity Catalog, and job orchestration capabilities. * Develop data pipelines, transformations, datasets, and data models within Palantir Foundry. * Implement cloud-native data orchestration using Azure Data Factory, Azure Functions, and Azure Storage, or equivalent AWS and GCP services. * Apply CI/CD practices for data services, including automated testing, validation, version control, and deployment. * Lead onboarding and migration efforts for data platforms, facilitating team adoption of modern data solutions. * Modernize existing Python and SQL codebases, promoting reusable engineering patterns and libraries. * Optimize data pipelines, strategies, and queries for performance, reliability, and cost-efficiency. * Establish best practices for data quality, observability, security, and governance. * Partner with stakeholders to gather requirements and translate program needs into scalable data solutions. * Communicate technical decisions and tradeoffs effectively to technical and non-technical audiences. * Provide technical leadership and supervision within cross-functional engineering teams. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)