> Markdown version of [/jobs/ext/2851137-data-engineer](https://www.wearedevelopers.com/jobs/ext/2851137-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** INFOPACT, INC. - **Location:** United States - **Contract:** Contract - **Skills:** Amazon Web Services, Amazon S3, Big Data, Continuous Integration, Data Architecture, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Transformation, Data Structures, Data Systems, Job Scheduling, Python (Programming Language), Meta-Data Management, Performance Tuning, Standard Sql, Software Configuration Management, SQL Databases, Enterprise Data Management, Data Processing, Gitlab, SC Clearance, Pandas, Data Lakes, Pyspark, Data Lineage, Data Analytics, Software Version Control, Data Pipelines, Databricks - **Published:** September 11, 2026 - **Apply:** https://www.thejobnetwork.com/job/767e7b12-bd16-4c1e-a0ea-15f5d63bcc8f/data-engineer ## About the Role * Demonstrated experience building, managing, and optimizing data pipelines using Databricks. * Experience working within Advana / the War Data Platform. * Advanced proficiency in Python, particularly PySpark and Pandas. * Expert-level SQL skills, including complex queries, transformations, joins, aggregations, and performance optimization. * Hands-on experience with Delta Lake, Autoloader, and Databricks job scheduling/workflows. * Strong experience designing and implementing ETL/ELT processes and data-wrangling solutions. * Experience working with large-scale Federal Financial Management and General Ledger data. * Knowledge of Universe of Transactions (UoT) reconciliation concepts and processes. * Experience working in AWS GovCloud, including S3. * Familiarity with Bronze/Silver/Gold Medallion data architecture. * Experience implementing automated data-quality and validation frameworks. * Understanding of CI/CD principles and experience with GitLab or similar version-control platforms. * Strong analytical, troubleshooting, and problem-solving skills. * Strong written and verbal communication skills., * Experience with Databricks Unity Catalog, including data governance, access controls, lineage, and metadata management. * Knowledge of SAP data structures and financial data. * Prior experience supporting DoD financial management, audit, ERP, or enterprise data initiatives. * Experience integrating financial and ERP data from multiple authoritative data sources. * Familiarity with financial auditability, reconciliation, data lineage, and traceability requirements. Security Clearance Candidates must possess an active Interim Secret clearance or higher and maintain the required clearance throughout employment. ## Description Infopact is seeking an experienced Data Engineer to support large-scale Department of Defense data and financial management initiatives. The ideal candidate will have hands-on experience developing and optimizing data pipelines using Databricks and Advana / the War Data Platform, with strong expertise in Python, PySpark, and SQL. This role will work with complex Federal Financial Management and General Ledger datasets to build scalable data pipelines, improve data quality, support reconciliation and analytics, and deliver trusted data products for mission and financial-management stakeholders., * Design, develop, maintain, and optimize scalable data pipelines within Databricks and Advana / the War Data Platform. * Build and manage ETL/ELT workflows for ingesting, cleansing, transforming, aggregating, and integrating large-scale datasets. * Develop Databricks solutions using Delta Lake, Autoloader, PySpark, SQL, and job scheduling/workflows. * Implement data architectures following the Medallion Architecture (Bronze, Silver, and Gold layers). * Process and analyze large-scale Federal Financial Management and General Ledger (GL) datasets. * Support Universe of Transactions (UoT) reconciliations, data traceability, and financial data validation. * Design and implement data-quality frameworks, automated validation checks, reconciliation controls, and exception handling. * Develop solutions within AWS GovCloud, including integration with services such as Amazon S3. * Troubleshoot pipeline failures, identify performance bottlenecks, and optimize data-processing workloads. * Support CI/CD processes and source-code management using GitLab or comparable technologies. * Collaborate with data analysts, product owners, financial-management SMEs, and Government stakeholders to translate business requirements into reliable data solutions. * Develop technical documentation covering data pipelines, transformations, business rules, data lineage, and operational procedures. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)