Senior Data Engineer in Glen Echo
Role details
Job location
Tech stack
Job description
As a key technical leader, you will collaborate with talented engineers, product owners, and government stakeholders to design, develop, and deploy innovative software solutions that make a real difference to security. You'll have the opportunity to shape the architecture, drive technical direction, and mentor others, all while working in a collaborative, agile, and growth-oriented environment., As a Data Engineer, you will design, develop, and optimize scalable data management solutions supporting advanced analytics and AI/ML workloads. Working closely with data scientists, software engineers, and infrastructure teams, you will build and maintain Elasticsearch and graph-based data platforms that enable efficient storage, discovery, and analysis of complex hierarchical data.
\n \n
-
Design and optimize Elasticsearch indices to efficiently manage large-scale hierarchical classification structures, ensuring high-performance search, aggregation, and update operations. \n
-
Design, implement, and maintain a graph data store supporting hierarchical graph structures optimized for large, dense batch updates and high-throughput analytics. \n
-
Develop scalable ingestion pipelines that support scalable graph analytics. \n
-
Design data schemas, indexing strategies, and partitioning approaches to maximize query performance, scalability, and storage efficiency. \n
-
Collaborate with infrastructure and platform engineering teams to deploy, operate, and optimize Elasticsearch and graph database services in a Kubernetes environment using cloud- technologies. \n
-
Partner with Data Scientists and AI/ML engineers to ingest, curate, manage, analyze, and securely expunge datasets throughout the data lifecycle. \n
-
Develop automated data loading, transformation, validation, and quality assurance pipelines supporting production analytics workflows. \n
-
Optimize graph and search infrastructure for high availability, resilience, and performance under large-scale analytical workloads. \n
-
Collaborate with software engineers and system architects to integrate graph and search services into microservice-based applications. \n
-
Participate in SAFe Agile development activities, including sprint planning, design reviews, architecture discussions, and technical demonstrations. \n
-
Foster a culture of innovation, collaboration, and professional development within the team. \n
-
Ensure sound engineering practices, compliance with policies, and delivery of high-quality software. \n
-
Coordinate with test teams to develop and monitor automated system integration tests. \n
-
Engage with cross-functional teams to identify and develop high-value integrations with other systems/applications. \n
-
Provide specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of COTS/GOTS in place of new development, and requirements analysis and synthesis from system level to individual software components. \n
Requirements
-
Bachelor's degree in Computer Science, Data Engineering, or related field and 12-15 years of relevant experience, or Master's with 10-13 years of experience. \n
-
Must possess an Active Top Secret/SCI clearance and ability to obtain and maintain a Polygraph. \n
-
Elasticsearch/OpenSearch architecture, index design, mappings, analyzers, and query optimization.