Data Engineer

We are looking for a Data Engineer passionate about working hands-on with challenging data engineering, data management, and analytics projects. In this role, you will be responsible for creating data pipelines, structures and integrations that power advanced analytics, machine learning models, and data-driven experimentation across the business. You will work at the intersection of data engineering and data science, enabling the rapid development, testing, and deployment of insights and predictive models by ensuring clean, reliable, and well-structured data is readily available., * Develop and maintain metadata-driven data pipelines or ingestion, transformation, and delivery of data

• Build and support ETL/ELT processes for both legacy and modern data sources
• Implement data transformations to convert legacy formats (e.g., SFTP, flat files) into modern formats (e.g., XML, JSON, APIs)
• Develop API integrations and data services supporting real-time and near real-time data exchange
• Support implementation of data quality checks, validation rules, and monitoring processes
• Collaborate with a Data Architect to implement data models, schemas, and integration patterns
• Optimize pipelines and queries for performance, scalability, and reliability
• Assist in documenting data flows, interfaces, and pipeline configurations
• Support DevSecOps practices to ensure a standardized data environment, including implementing CI/CD pipelines, automated testing, and deployment
• Work in cross-functional team with data scientists, data engineers, and business stakeholders

Do you have what it takes? Are you driven to implement creative solutions that unravel complex and ever-changing challenges? We value passion, curiosity, and perseverance with an ability to communicate ideas and results to diverse audiences. We look for people who thrive in collaborative and independent assignments, have the aptitude to learn new data quickly, and who are willing to mentor junior team members.

• Experience developing and maintaining ETL pipelines and data integration workflows
• Strong proficiency in SQL and Python
• Experience with cloud platforms (AWS, Azure, GCP, GovCloud) and cloud-native architectures
• Hands-on experience with cloud-based data warehouses and object storage (S3, Redshift, Snowflake)
• Experience with API integration and data exchange
• Understanding of database design principles, data modeling, schema development, and data-centric documentation
• Experience integrating data from a variety of data source types
• Experience improving code performance and query optimization
• Outstanding problem-solving skills
• Excellent verbal and written communication skills
• 4+ years of experience as a Data Engineer or similar role
• Minimum Education: Bachelor’s degree in Computer Science, Mathematics, or comparable academic discipline
• Must hold an active Secret Clearance
• Acceptable candidates must successfully pass a drug test and background screen

Preferred Qualifications:

• Knowledge of Air Force logistics systems
• Understanding of logistics, supply chain, or maintenance data
• Experience with Databricks
• Understanding of data privacy, security, and compliance considerations
• CompTIA Security+ certification or ability to obtain

At Illumination Works, we know data, and we should, we’ve been doing it since we started in 2006! We specialize in everything data from big data to data science, data engineering, software engineering, and cloud design. We are a trusted technology partner in user-centered digital transformation-delivering impactful business results to clients. We partner with customers to solve their unique technology and data challenges and stay on top of modern technologies and advancements leveraging our Innovation Lab. Check out our website to learn more at www.ilwllc.com . Why choose us? We invest in our employees in all aspects of their life and we value family. We offer market-competitive salary, a generous PTO package, and comprehensive medical, dental, vision and life insurance plans. We also offer 401K, short/long-term disability insurance, a fun and engaging culture, and training opportunities to keep you up to speed on the latest technologies.

Commitment to Non-Discrimination All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran, or any other status protected by applicable federal, state, local, or international law. Know Your Rights Poster E-Verify Participation Poster (uscis.gov)