Data Engineer - Spear AI

Spear AI seeks a Data Engineer to build robust, secure data infrastructure supporting the an IC Task Force. The role involves creating resilient pipelines to power analytics and decision support systems. Primary Responsibilities: Design and manage secure data pipelines enabling ML and analytics workflows. Handle data ingestion, transformation, and validation with auditable, secure processes. Collaborate with mission engineers and data scientists to align infrastructure with operational objectives. Optimize data processing and storage for real-time and batch operations. Ensure compliance with DIA’s data governance and cross-domain security standards.

Active Secret clearance. 3-7 years in data engineering, preferably within secure, high-side environments. Proficiency in Python, Spark, SQL, and data orchestration tools (e.g., Airflow). Experience with classified data management, secure networking, and infrastructure optimization. Preferred Experience: Familiarity with IC standards (UDS, IC ITE) and secure cloud environments (AWS GovCloud, C2S). Strong troubleshooting and optimization skills within complex operational settings.