4301 Data Engineer

Procession Systems
Chantilly, VA, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Business Analytics Applications Big Data Cloud Computing Computer Programming Databases Data as a Services Information Engineering Extract Transform Load (ETL) Data Security Data Stores
+28 more
Data Systems Relational Databases Elasticsearch Data Intelligence PostgreSQL Microsoft SQL Server MySQL Query Optimization RabbitMQ Redis Scaled Agile Framework SQL Databases Systems Integration System Availability Indexer Containerization Semi-structured Data Kubernetes Infrastructure Automation Frameworks Information Technology Low Latency Transport Protocols Apache Nifi Graphql Api Design Data Pipelines Devsecops Docker

Job description

  • Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains
  • Architect and develop ETL workflows for highly sensitive data in classified environments
  • Support IC Data Services requirements by integrating various intelligence data sources and systems
  • Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
  • Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data
  • Design strategies for enterprise database systems and set standards for operations, programming, and security
  • Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
  • Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
  • Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets
  • Integrate new systems with existing warehouse structures and refine system performance and functionality
  • Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices
  • Provide technical leadership and mentorship to other team members
  • Participate in Program Increments (PIs) and Agile Release Train (ART) activities

Requirements

We are seeking a highly skilled Senior-level Data Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources., * Bachelor’s degree in Computer Science, Data Science, Engineering, or related field

  • Minimum of 10 years of experience in data engineering or related field
  • Experience with SAFe Agile framework
  • Strong understanding of forensic and investigative data requirements
  • Demonstrated experience designing and implementing data solutions in secure government environments
  • Advanced proficiency with
  • Python for data processing, automation and ETL workflow orchestration
  • SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization
  • Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)
  • Data pipeline technologies (Apache Nifi, Cribl)
  • Cross-domain ETL solutions for secure data transfer between classification levels
  • Containerization and orchestration technologies (Docker, Kubernetes)
  • Cloud platforms (AWS GovCloud, SC2S, C2S)
  • Experience handling data in accordance with IC security protocols and classification guidelines
  • IC Data Services frameworks and integration protocols
  • GraphQL: schema design, API development, query optimization, and integrations
  • DevSecOps practices and tools in classified environments
  • RabbitMQ and Redis

DESIRED QUALIFICATIONS:

  • Experience with Intelligence Community Data Services and standards
  • Prior work with cross-domain solutions for ETL processes
  • Knowledge of IC specific data formats, schemas and transfer protocols
  • Experience with specialized IC analytics platforms and data repositories
  • Prior work integrating intelligence data across multiple enclaves
  • Cloud certification

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:42 min

Comparing in-memory and Redis storage for cache scalability

Simone Sanfratello · WWC 2022

Videos

See all

Related articles

See all