Data Engineer (Remote)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+17 more
Job description
We are seeking an experienced Data Engineer to support a high-visibility federal modernization initiative within a large Department of Defense environment. This role focuses on building and optimizing scalable data pipelines, transforming complex financial and operational datasets, and enabling advanced analytics capabilities across enterprise systems.
This is an excellent opportunity for a data professional who enjoys working with big data technologies, cloud environments, and modern data engineering practices while supporting mission-critical programs., Design, develop, and maintain scalable data pipelines for ingesting, transforming, and processing large datasets. Build, optimize, and automate ETL/ELT workflows to support analytics and reporting requirements. Perform data cleansing, transformation, aggregation, and data wrangling activities to improve data quality and usability. Develop and maintain solutions using Databricks and related technologies. Implement automated data validation processes and data quality controls. Work with large-scale financial and transactional datasets, ensuring data integrity and accuracy. Collaborate with analysts, product owners, engineers, and stakeholders to deliver data solutions supporting business objectives. Support cloud-based data environments and storage solutions. Troubleshoot, optimize, and enhance existing data pipelines and workflows. Contribute to CI/CD processes, code reviews, and version control best practices.
Requirements
9+ years of professional Data Engineering experience. Strong experience building and maintaining enterprise-scale data pipelines. Hands-on expertise with: Databricks ETL/ELT development Python PySpark SQL Big Data processing and architecture Data wrangling, cleansing, and transformation Experience designing and implementing data integration frameworks. Advanced SQL skills for complex querying and data transformation. Experience working with large datasets in cloud-based environments. Strong analytical and problem-solving abilities. Excellent communication and collaboration skills., Experience working within the Advana platform. Knowledge of Databricks Delta Lake, Autoloader, and job scheduling. Familiarity with Unity Catalog for data governance. Experience with AWS GovCloud and Amazon S3. Understanding of Medallion Architecture (Bronze, Silver, Gold layers). Experience implementing automated data quality frameworks. Knowledge of Federal Financial Management or General Ledger data. Experience with Universe of Transactions (UoT) reconciliations. Familiarity with SAP data structures. Experience using GitLab and CI/CD methodologies.
Technical Environment Databricks Python PySpark SQL AWS GovCloud Amazon S3 Delta Lake GitLab CI/CD Pipelines Enterprise Data Platforms
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.clearancejobs.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Fully Remote Software Engineer Jobs
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know