Data Engineering Software Developer
Leidos, Inc.
Washington, DC, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on jobs.military.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$107,900.0 - $195,050.0
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Agile Methodology
Amazon Web Services
Amazon S3
Confluence
JIRA
Microsoft Azure
Big Data
Configuration Management Databases
Information Engineering
Extract Transform Load (ETL)
Data Transformation
+43 more
Data Security
Data Warehousing
DevOps
Elasticsearch
Apache Hadoop
Python (Programming Language)
Network Security
Named Entity Recognition
Scrum Methodology
Software Tools
Logstash
Ansible
Prometheus
Runbook
Shell Script
SQL Databases
Systems Architecture
Systems Integration
Text Mining
Data Logging
Google Cloud
Computer Network Operations
Cloud Platform System
Data Ingestion
Snowflake
Grafana
Apache Spark
Git
Data Lakes
Kubernetes
Infrastructure Automation Frameworks
Information Technology
Apache Kafka
Apache Nifi
Bitbucket
Puppet
Kibana
Software Version Control
Data Pipelines
Elk Stack
Confluent
Amazon Redshift
Databricks
Requirements
- Bachelor’s degree in Computer Science, Engineering, or related technical discipline and 8+ years of relevant experience.\n
- An active TS/SCI clearance \n
- Willingness to complete and maintain additional customer suitability screenings throughout employment\n
- Current Security+ certification or higher/equivalent\n
- Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.\n
- Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).\n
- Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.\n
- Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.\n
- Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.\n
- Experience with Linux/UNIX system administration and automation.\n
- Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).\n
- Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.\n
- Strong communication and documentation skills for collaboration and knowledge sharing.\n, * Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.\n
- Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack for text mining, summarization, search, and entity extraction.\n
- Experience with cloud-based data platforms (AWS, Azure, GCP, AWS GovCloud), cloud-integrated platforms, and infrastructure as code, including networking and security policies.\n
- Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic).\n
- Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks.\n
- Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence.\n
- Certified Confluent Developer and Certified Elastic Engineer.\n
- Excellent communication and collaboration skills, with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software, integration, and data engineering practices.\n
- Apply knowledge of system architecture, networks, and centralized logging (ELK) to support data transformation initiatives.\n
Benefits & conditions
- Willingness to complete and maintain additional customer suitability screenings throughout employment\n
- Current Security+ certification or higher/equivalent\n
\n \nPrimary Responsibilities:\n \n \n
- Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.\n
- Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.\n
- Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.\n
- Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.\n
- Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.\n
- Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.\n
- Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.\n
- Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.\n
About the company
Join Leidos’ Digital Sector as we stand up a brand-new Agile development team at the forefront of federal IT modernization, delivering real digital transformation where it matters most. This is a rare ground-floor opportunity to architect, build, and integrate cutting-edge infrastructure solutions in support of some of our nation’s most sensitive and critical missions.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on jobs.military.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
LM
Luis Minvielle
Fully Remote Software Engineer Jobs
over 2 years ago
IK
Igor Khokhriakov
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
about 1 month ago
EM
Eli McGarvie
Data Engineer Salary UK
over 3 years ago
LM
Luis Minvielle
What’s the Difference between a Junior, Mid, and Senior Developer?
over 3 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago