4301 Data Engineer
Procession Systems
Chantilly, United States of America
12 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Chantilly, United States of America
Tech stack
Agile Methodologies
Amazon Web Services (AWS)
Business Analytics Applications
Big Data
Cloud Computing
Computer Programming
Databases
Data as a Services
Information Engineering
ETL
Data Security
Data Stores
Data Systems
Relational Databases
Elasticsearch
Data Intelligence
PostgreSQL
Microsoft SQL Server
MySQL
Query Optimization
RabbitMQ
Redis
Scaled Agile Framework
SQL Databases
Systems Integration
System Availability
Indexer
Containerization
Semi-structured Data
Kubernetes
Infrastructure Automation Frameworks
Information Technology
Low Latency
Transport Protocols
Apache Nifi
GraphQL
Api Design
Data Pipelines
Devsecops
Docker
Job description
- Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains
- Architect and develop ETL workflows for highly sensitive data in classified environments
- Support IC Data Services requirements by integrating various intelligence data sources and systems
- Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
- Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data
- Design strategies for enterprise database systems and set standards for operations, programming, and security
- Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
- Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
- Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets
- Integrate new systems with existing warehouse structures and refine system performance and functionality
- Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices
- Provide technical leadership and mentorship to other team members
- Participate in Program Increments (PIs) and Agile Release Train (ART) activities
Requirements
We are seeking a highly skilled Senior-level Data Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources., * Bachelor's degree in Computer Science, Data Science, Engineering, or related field
- Minimum of 10 years of experience in data engineering or related field
- Experience with SAFe Agile framework
- Strong understanding of forensic and investigative data requirements
- Demonstrated experience designing and implementing data solutions in secure government environments
- Advanced proficiency with
- Python for data processing, automation and ETL workflow orchestration
- SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization
- Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)
- Data pipeline technologies (Apache Nifi, Cribl)
- Cross-domain ETL solutions for secure data transfer between classification levels
- Containerization and orchestration technologies (Docker, Kubernetes)
- Cloud platforms (AWS GovCloud, SC2S, C2S)
- Experience handling data in accordance with IC security protocols and classification guidelines
- IC Data Services frameworks and integration protocols
- GraphQL: schema design, API development, query optimization, and integrations
- DevSecOps practices and tools in classified environments
- RabbitMQ and Redis
DESIRED QUALIFICATIONS:
- Experience with Intelligence Community Data Services and standards
- Prior work with cross-domain solutions for ETL processes
- Knowledge of IC specific data formats, schemas and transfer protocols
- Experience with specialized IC analytics platforms and data repositories
- Prior work integrating intelligence data across multiple enclaves
- Cloud certification