Data Engineer
Role details
Job location
Tech stack
Job description
The Leidos Digital Modernization Group seeks a Data Engineering Specialist to support the Global Management System (GMS) Team for the Global Solutions Management - Operations II (GSM-O II) contract. This contract includes the Operations, Sustainment, Maintenance, Repair and Defense of the Defense Information System Network (DISN) within the DOD Information Network (DODIN) in support of the Defense Information Systems Agency (DISA). It also includes support for other key tasks for DISA, including the transformation of DISA's operational mission through innovation, and support to DISA's mission partners.
The candidate must be within commuting distance of Scott AFB or Ft. Meade. At a minimum, a Secret clearance and Security + certification (or other applicable DoD 8570 IAT II certification) upon the start of employment.
The candidate will support data engineering activities, contributing to the integration and enrichment of DISN network topology data to enable advanced data correlation and analytics. They will assist in designing and implementing data enrichment pipelines, integrating multiple data sources into Confluent (Kafka) and Elastic platforms, and help maintain Kafka and Elastic clusters to support mission-critical operations. The candidate will contribute to platform sustainment and reliability by addressing operational challenges and supporting the automation of the software development lifecycle, including CI/CD pipeline development, containerization, and automated testing, while following DevOps best practices. The role involves active participation in Agile scrum teams, collaborating with team members, and sharing knowledge to support team growth. Additionally, the candidate will help develop and maintain technical documentation, ensuring solutions align with DoD security standards and compliance requirements.
As a GMS team member, you will work as part of a fast paced, Agile development and implementation team to architect, design and develop an integrated solution that expands the foundational Integrated Data Architecture platform (Confluent and ELK platform). You will work alongside others in a matrixed organization across the project.
Primary Responsibilities:
-
Contribute to data engineering efforts by supporting the integration and enrichment of DISN network topology data for advanced data correlation and analytics.
-
Participate in technical discussions with internal and external stakeholders to support solution design and implementation.
-
Develop, test, and deploy data pipelines and integration solutions across distributed systems and cloud environments, using Python, JavaScript, Java, and SQL.
-
Assist in requirements gathering and collaborate with stakeholders to design and implement data enrichment pipelines, integrating diverse data sources into Confluent (Kafka) and Elastic platforms.
-
Develop and maintain Kibana visualizations and dashboards to support operational insights.
-
Support Kafka system integrations between Elasticsearch/Logstash and other systems.
-
Collaborate within Agile scrum teams, contribute to team deliverables, and share knowledge with peers.
-
Communicate and coordinate effectively with geographically distributed team members to achieve project objectives.
-
Troubleshoot and help resolve installation, infrastructure, and system issues; report and help mitigate technical risks.
-
Develop and maintain technical documentation, including DoD requirements, interface documents, and security compliance artifacts.
-
Ensure solutions comply with DoD security standards and guidelines, and support platform sustainment and reliability by addressing operational challenges as needed
Requirements
-
Bachelor's degree from an accredited college in a related discipline, or equivalent experience/combined education, with 4-8 years of professional experience; or 2-6 years of professional experience with a related master's degree.
-
4+ years of experience in software engineering, data engineering, or business/data analysis, preferably within Agile/Scrum teams.
-
Hands-on software development experience with Python, Java, SQL, and working knowledge of JavaScript and HTML.
-
Experience with distributed version control systems such as Git and Bitbucket.
-
Experience designing, developing, and optimizing ETL processes and data pipelines, including integration with event streaming platforms like Kafka.
-
Experience in data modeling, unification, and analytics to support data-driven projects.
-
Experience implementing application and system integrations, including Kafka and Elastic platform integrations.
-
Understanding of networking and internet protocols, with experience supporting network-centric or data-driven environments.
-
Experience developing and deploying software on UNIX/Linux command line platforms.
-
Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders.
-
Experience with Agile project management and collaboration tools such as JIRA and Confluence.
-
Proficiency with data analytics and visualization tools, such as Kibana, Power BI, Tableau, and the ELK stack (Elasticsearch, Logstash, Kibana).
Skills
Python, Data, Etl, data pipeline, kafka, Experience with CI/CD techniques, containerized pipelines, and DevOps practices, including automating software delivery processes.
Familiarity with artificial intelligence and machine learning concepts, and interest in supporting the integration of AI/ML capabilities into data platforms.
Experience with data integration, storage, and analysis technologies such as Kafka, Elastic, Spark, or NiFi.
Hands-on experience with Kafka connector integrations and working knowledge of ksqlDB and Kafka Streams for real-time data processing.
Ability to develop software designs for streaming data applications, particularly using Kafka Streams or ksqlDB.
Experience developing and optimizing Kafka system integrations between Elasticsearch/Logstash and other systems.
Experience designing and implementing application deployment pipelines and developing software in containerized environments using Kubernetes and Docker.
Familiarity with Kubernetes deployment, Agile methodologies, and collaborative development tools.
Experience developing and deploying software in AWS cloud environments, including basic configuration of cloud infrastructure, networking, and security policies (GovCloud experience a plus).
Experience with full software lifecycle automation (design, development, testing, deployment), including production deployments.
Experience designing and building automated software testing pipelines using tools such as Ansible, Selenium, JMeter, Junit, or similar.
Experience developing and deploying software in DoD environments (DISA experience a plus), including building applications that meet DoD security standards and implementing security guidelines (e.g., STIGs).
Ability to support the development of DoD requirements, traceability matrices, project plans/schedules, and contribute to software systems engineering documents and interface documents (IDDs/ICDs).
Experience with Agile methodologies and Atlassian tools, including JIRA and Confluence, for project
Experience Level
Intermediate Level
Benefits & conditions
This is a Contract position based out of Fort Meade, MD.
Pay and Benefits
The pay range for this position is $60.00 - $75.00/hr.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: * Medical, dental & vision * Critical Illness, Accident, and Hospital * 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available * Life Insurance (Voluntary Life & AD&D for the employee and dependents) * Short and long-term disability * Health Spending Account (HSA) * Transportation benefits * Employee Assistance Program * Time Off/Leave (PTO, Vacation or Sick Leave)
Workplace Type