Data Engineer

Our top Client is hiring key resources for their existing program supporting the DoD on various efforts around their core data and analytics platform. In this position, you will help lead core data platform engineering - owning the full data pipeline lifecycle from ingestion to delivery, expanding the foundational Integrated Data Architecture platform, and building scalable, optimized data infrastructure in support of mission-critical DoD network operations., * Contribute to data engineering efforts by supporting the integration and enrichment of DISN network topology data for advanced data correlation and analytics.

• Participate in technical discussions with internal and external stakeholders to support solution design and implementation.
• Develop, test, and deploy data pipelines and integration solutions across distributed systems and cloud environments, using Python, JavaScript, Java, and SQL.
• Assist in requirements gathering and collaborate with stakeholders to design and implement data enrichment pipelines, integrating diverse data sources into Confluent (Kafka) and Elastic platforms.
• Develop and maintain Kibana visualizations and dashboards to support operational insights.
• Support Kafka system integrations between Elasticsearch/Logstash and other systems.
• Collaborate within Agile scrum teams, contribute to team deliverables, and share knowledge with peers.
• Communicate and coordinate effectively with geographically distributed team members to achieve project objectives.
• Troubleshoot and help resolve installation, infrastructure, and system issues; report and help mitigate technical risks.
• Develop and maintain technical documentation, including DoD requirements, interface documents, and security compliance artifacts.
• Ensure solutions comply with DoD security standards and guidelines, and support platform sustainment and reliability by addressing operational challenges as needed

Do you have experience in Software testing?, Do you have a Bachelor’s degree?, * 7+ years of hands-on end to end data engineering experience - building and optimizing ETL processes and data pipelines

• 3+ years’ experience building pipelines with Elastic/ELK stack (Elasticsearch, Logstash, Kibana)
• Extensive experience utilizing data pipeline messaging or flow platforms such as Apache Kafka/Confluent or Nifi, AWS Kinesis or EventBridge, Azure Event Hubs, RabbitMQ
• Experience with OpenShift or Kubernetes for container orchestration and platform deployment
• Python, Java, and/or SQL programming experience
• Experience working in Agile development environment (SDLC) supporting sprint cycles, testing, and deployment activities
• Active SECRET Clearance or higher REQUIRED
• CompTIA Security+ certification required within the first 14 days of employment
• B.S. Degree

Nice to have:

• Certified Confluent Developer and/or Certified Elastic Engineer Certifications
• Databricks platform experience
• Experience developing and deploying software in a DoD environment (DISA experience is a plus)
• Experience with Atlassian tools including JIRA and Confluence