> Markdown version of [/jobs/ext/2956828-data-engineer](https://www.wearedevelopers.com/jobs/ext/2956828-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Illumination Works - **Location:** United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** CompTIA Security+, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Structures, Data Systems, Database Design, Python (Programming Language), Machine Learning, Operational Data Store, SQL Databases, Data Streaming, Systems Integration, Freeform SQL, Data Ingestion, Sql Optimization, SC Clearance, Data Lakes, Information Technology, Data Management, Data Pipelines, Databricks - **Published:** September 17, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9171154/data-engineer ## About the Role Do you have what it takes? We value passion, curiosity, and perseverance, along with the ability to communicate ideas and results to diverse audiences. We look for people who thrive in both collaborative and independent assignments, quickly learn new data and business domains, and enjoy solving complex data challenges., * 4+ years of experience as a Data Engineer or in a similar data-focused role * Possess advanced SQL skills (i.e., complex joins, aggregations, window functions, transformations) * Proficiency with Python for data engineering and transformation * Hands-on experience with Databricks, including development and maintenance of notebooks and data pipelines * Experience developing and maintaining ETL/ELT pipelines and data integration workflows * Experience with Delta Lake * Experience with database design, data modeling, schema development, and data-centric documentation * Experience integrating and transforming data from multiple data source types * Experience troubleshooting data issues and optimizing queries and pipelines * Strong analytical and problem-solving skills * Excellent verbal and written communication skills and ability to collaborate effectively with technical and business stakeholders * Bachelor's degree in Computer Science, Mathematics, Data Science, Engineering, or a comparable academic discipline * Must hold an active Secret clearance with eligibility for Top Secret (U.S. Citizenship required) * Must successfully pass required background screening and drug testing Preferred Qualifications * Experience supporting data scientists and advanced analytics or machine learning use cases * Functional knowledge of Department of Defense War or U.S. Air Force data sources and systems * Experience working with logistics, supply chain, maintenance, or other operational data * CompTIA Security+ certification * Holds Top Secret clearance ## Description We are seeking an experienced Data Engineer to support challenging data engineering, data management, and analytics initiatives. In this role, you will develop and maintain data pipelines and data structures that enable advanced analytics and data science capabilities. You will work closely with data scientists and other technical stakeholders to understand evolving data needs, incorporate new data elements, and ensure reliable, high-quality data is available for analysis., * Develop, maintain, and enhance data pipelines using Python, SQL, and Databricks * Develop and maintain Databricks notebooks supporting data ingestion, transformation, and delivery * Design and maintain data tables, schemas, and Delta Lake structures to support analytics and data science requirements * Work closely with data scientists to understand data requirements and modify pipelines, tables, and data structures as needs evolve * Develop complex SQL queries using joins, aggregations, window functions, and other advanced techniques to transform and prepare data * Integrate and transform data from multiple structured and semi-structured data sources * Support data quality through validation, troubleshooting, and resolution of data issues * Optimize data pipelines, SQL queries, and data structures for performance * Document data sources, transformations, data flows, schemas, and pipeline configurations * Collaborate with data scientists, engineers, analysts, and business stakeholders to deliver data solutions that support mission requirements ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post) - [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)