> Markdown version of [/jobs/ext/4758969-data-scientist-data-engineer](https://www.wearedevelopers.com/jobs/ext/4758969-data-scientist-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Scientist/ Data Engineer - **Company:** Illumination Works - **Location:** United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Data Analysis, Big Data, Cloud Computing, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Data Warehousing, Relational Databases, Distributed Computing Environment, Monitoring of Systems, Python (Programming Language), Machine Learning, SQL Databases, Enterprise Data Management, Data Processing, Palantir Foundry, SC Clearance, Pyspark, Information Technology, Data Lineage, Machine Learning Operations, Software Version Control, Data Pipelines, Legacy Systems, Databricks - **Published:** November 17, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9314749/data-scientist-data-engineer ## About the Role The ideal candidate brings strong hands-on experience with Databricks, Python, PySpark, and SQL, along with experience applying AI/ML techniques to complex enterprise data. The position will support the integration, transformation, and analysis of financial data from legacy systems within the War Data Platform (WDP). Experience with DoW financial management, budgeting, forecasting, cost analysis, or related business domains is highly desired., * Bachelor's degree in Data Science, Computer Science, Data Engineering, Mathematics, Statistics, Engineering, or a related technical field. * 3+ years of professional experience in data science, data engineering, machine learning, or related technical disciplines. * Strong hands-on experience with Databricks, including data processing, transformation, analytics, and AI/ML. * Proficiency in Python, PySpark, and SQL, including experience processing and analyzing large, complex datasets. * Experience designing, developing, and maintaining data pipelines, data integration, and data quality and validation workflows. * Experience developing, applying, and implement AI/ML models and advanced analytical solutions. * Working knowledge of relational databases, data warehousing concepts, and data processing optimization. * Strong analytical problem-solving skills and ability to troubleshoot data processing and integration issues. * Effective communication skills and ability to collaborate with technical and functional stakeholders. * Active Secret clearance or ability and willingness to obtain one (requires U.S. citizenship)., * Experience working within the War Data Platform (WDP), Palantir Foundry/Envision, or other DoW enterprise analytics environments. * Air Force or broader DoW financial management experience, including familiarity with financial systems, accounting, budgeting, forecasting, or cost analysis. * Familiarity with Financial Improvement and Audit Remediation (FIAR), financial reconciliation, audit readiness, and financial data quality requirements * Experience applying AI/ML to financial management, including forecasting, anomaly detection, reconciliation, or process automation. * Experience with data orchestration, incremental processing, automated monitoring, and CI/CD pipelines. * Experience with MLOps, model monitoring, and deployment of AI/ML solutions in enterprise environments. * Familiarity with cloud-based analytics platforms, distributed data processing, and data governance practices. ## Description * Design, develop, test, and maintain data pipelines using Databricks, Python, PySpark, and SQL to ingest, integrate, and transform complex financial data. * Implement transformation rules, data validation, and quality controls to ensure accurate, reliable, and consistent datasets. * Identify, evaluate, and implement high-value AI/ML use cases that improve financial management processes, analytics, and decision-making. * Develop, train, evaluate, and operationalize AI/ML models and advanced analytics solutions using Databricks. * Apply predictive analytics, forecasting, anomaly detection, and automation techniques to support financial and business operations. * Collaborate with functional stakeholders, data architects, and technical teams to translate business requirements into scalable data engineering and AI/ML solutions. * Maintain technical documentation, data lineage, and testing artifacts while following established development, version control, and deployment practices. * Communicate analytical findings, technical recommendations, and project outcomes to technical and nontechnical stakeholders.