Lead Data Flow Engineer (Java/NiFi Focus) - PRIME, Hybrid - TS/S
Role details
Job location
Tech stack
Job description
As a Senior/Lead Data Flow Engineer, you will lead efforts in strategic data acquisition, analysis, and sharing. This role focuses on building and managing software infrastructure for large-scale big data ingestion. You will be responsible for modifying existing data sources, implementing testing/monitoring, and troubleshooting complex dataflow issues. You will act as a technical lead, ensuring data integrity and fostering innovation within the department while solving high-level technical problems from ingest to visualization.
Requirements
Experience: 14+ years of experience in software development, data engineering, or database engineering (4 additional years of experience can substitute for a degree). Primary Tech Stack: High proficiency in Java (including Unit/Integration testing) and significant experience with Apache NiFi administration and data flow building. Cloud & Tools: Experience with AWS S3 and SQS solutions, Kafka, Maven, and GitLab. Technical Depth: Expertise in ETL creation, data modeling design, and Linux OS (BASH) server administration. Data Skills: Fluency with data extraction, custom logic development, and familiarity with YAML, JSON, and XML. Desired Extras: Experience with Apache Airflow, Mage AI, Docker/Kubernetes, and prior cyber security operations support. Certifications: DoD IAT II or higher (Sec+, etc) required for consideration.
*Please note: Applicants may be required to complete a coding challenge during the interview process per customer requirements.
Clearance Requirements An active TS/SCI is required for consideration. Please note, you must have the required clearance for consideration; under-cleared applicants will not receive a response.