Data Engineer - Expert
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+28 more
Job description
- Lead the architectural design and implementation of distributed, high-throughput batch and streaming data platforms.
- Optimize distributed execution engines (Spark, Trino/Presto) to handle petabyte-scale datasets under strict SLAs.
- Implement Infrastructure as Code (IaC) to provision data platform assets across multi-cloud infrastructure.
- Establish zero-trust security controls, data lineage tools, and automated compliance scanning for regulated data environments.
- Act as a Technical Pod Lead, driving Agile sprint deliverables, establishing technical standards, and mentoring data engineering staff.
Requirements
Data Management, Defense Intelligence, Data Analysis, Architectural Services, Data Quality, Cloud Computing, High Throughput, Service Level Agreement (SLA), Data Sets, Mentoring, * Clearance: Must be a US Citizen holding an active TS/SCI security clearance with an active Full-Scope Polygraph.
- Education: Bachelorββs degree in Computer Science, Information Systems, Engineering, or a related technical field (Masterβs degree preferred).
- Experience: 7-10+ years of data engineering experience.
Technical Competencies:
- Data Processing Frameworks: Expert-level mastery of Apache Spark, Flink, Kafka, Ray, and workflow orchestration engines.
- Database Systems: Deep understanding of distributed systems internals, LSM trees, column-family stores, and lakehouse storage formats (Delta Lake, Apache Iceberg, Apache Hudi).
- Data Modeling: Enterprise data strategy, conceptual-to-physical data modeling, and streaming data schema contracts.
- Programming & Scripting: Mastery of Python, Scala, SQL, and Go for high-performance data platform development.
- Containerization: Advanced Kubernetes cluster management, custom operators for data platforms, and service mesh integration.
- Agile Frameworks: Proven experience acting as a Technical Lead or Scrum Master directing engineering pods.
- Multi-Cloud Architecture: Advanced experience architecting multi-cloud and hybrid cloud data platform solutions (IaC via Terraform).
- Security Scanning Tooling: Deep understanding of DevSecOps pipelines, automated compliance testing, and secret rotation management.
Desired Qualifications:
- Advanced Certifications: AWS Certified Solutions Architect - Professional, CISSP, or Databricks Certified Professional Data Engineer.
- Proven track record architecting data solutions for deployment in air-gapped or high-assurance defense networks.
Position Clearance Requirement:
US Citizenship with an active TS/SCI security clearance with Full-Scope Polygraph
Benefits & conditions
Target Salary Range: $165,000.00 - $200,000.00 (Commensurate with specialized expertise and technical skillset).
Equal Opportunity Employer:
We are proud to be an EEO/AA employer Minorities/Women/Veterans/Disabled and other protected categories.
In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.
We are strictly looking for direct, full-time W2 employees. We do not engage with third-party staffing agencies, C2C, or 1099 independent contractors for this role.
About the company
Dark Wolf constructs and deploys data management and analytics solutions for the defense and intelligence communities. Weβre proud to boast a world-class engineering team that thrives on rolling up their sleeves to solve your missionβs biggest challenges.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦