Data Engineer Software Developer

CareerCircle
St. Louis, MO, United States
13 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience required
0 years minimum
Compensation
$87,100.0 - $157,450.0
Working hours
Regular working hours

Tech stack

Query Performance HTML Java (Programming Language) JavaScript (Programming Language) Microsoft Excel Microsoft Windows Access Network Active Directory Application Programming Interfaces (APIs) Agile Methodology Ajax (Programming Language) Amazon Web Services
+121 more
Amazon Elastic Compute Cloud Amazon S3 Data Analysis Confluence JIRA Microsoft Azure Big Data Cascading Style Sheets (CSS) Cloud Engineering Configuration Management Databases Configuration Management Code Review Collaborative Software CompTIA Security+ Cyber Security Continuous Integration Data Architecture Data Validation Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Transformation Data Security Data Systems Data Warehousing Software Design Patterns Linux DevOps Web Development Django Web Framework Elasticsearch Geospatial Intelligence Apache Hadoop Human-Computer Interaction Iterative and Incremental Development Virtual Private Networks (VPN) JavaScript Libraries JSON JQuery Python (Programming Language) Local Area Networks Network Security PostgreSQL MySQL Virtual Desktops Named Entity Recognition Node.Js OpenShift Windows PowerShell Scrum Methodology Remote Access Technology Software Tools Logstash Ansible Prometheus Runbook Salesforce.Com Secure Coding Shell Script Software Engineering Software Systems SQL Databases Systems Architecture Systems Integration Text Mining Wide Area Networks Web Application Frameworks Website Wireframe Extensible Markup Language (XML) Data Logging Google Cloud Computer Network Operations Cloud Platform System Data Ingestion Microsoft Power Automate ReactJS Flask (Web Framework) Snowflake Grafana Database Optimization Apache Spark Spring-boot Multi-Cloud Indexer Infrastructure as Code (IaC) Backend Gitlab Git Cloudformation Microsoft InTune Vue.js SC Clearance Containerization Data Lakes AngularJS Kubernetes Infrastructure Automation Frameworks Information Technology Apache Kafka Apache Nifi Bitbucket Data Management Front End Software Development Puppet Kibana Restful APIs Terraform Software Version Control Data Pipelines Devsecops Docker Elk Stack Jenkins Servicenow Confluent Amazon Redshift Databricks User Accounts Programming Languages Microservices

Job description

JIRA Linux CI/CD DevOps Kibana Ansible Grafana Big Data Equities Indexing Logstash Dashboard Analytics OpenShift Bitbucket Confluent Pipelines Operations Management Automation Kubernetes Data Lakes Encryption Databricks Scalability Market Data Text Mining Apache NiFi Data Quality Apache Kafka Communication Observability Telecommuting Data Security Collaboration Apache Hadoop Virtual Teams Elasticsearch Data Recording Data Ingestion Data Pipelines Version Control Microsoft Azure Data Governance Data Validation Amazon Redshift Ancient History Computer Science Data Integration Business Metrics Data Warehousing Data Engineering Network Security Secret Clearance Agile Methodology CompTIA Security+ Data Architecture Query Performance Performance Metric Security Clearance Systems Integration Amazon Web Services Elastic (ELK) Stack User Interface (UI) Data Transformation User Experience (UX) Systems Architecture Intelligent Networks Business Intelligence Requirements Analysis Prometheus (Software) Technical Documentation Configuration Management SQL (Programming Language) IAT Level II Certification Snowflake (Data Warehouse) Java (Programming Language) Git (Version Control System) Extract Transform Load (ETL) Scrum (Software Development) Infrastructure as Code (IaC) React.js (Javascript Library) Python (Programming Language) Back End (Software Engineering) JavaScript (Programming Language) Configuration Management Databases Chef (Configuration Management Tool) Puppet (Configuration Management Tool)

Salesforce Developer, The Leidos Digital Modernization Group seeks a Data Engineer Software Developer for the Global Solution Management - Operations II (GSM-O II) contract, under the Global Automations & Intelligent Network Solutions (GAINS) Team. Seeking a Back-End Developer to join the Real-Time Visibility (RTV) team, focused on designing, building, and maintaining the infrastructure and systems that collect, store, process, and analyze large volumes of network operations data for the DISN network. This role is critical for ensuring that data from disparate sources-such as logs, performance metrics, events, ticketing, ordering, and CMDB systems-is readily available, reliable, and performant for business and mission use. The existing platform is built on Elastic stack and Confluent Kafka platforms. The ideal candidate will have a strong background in data engineering, platform operations, and integration, with experience in large-scale, mission-critical environments., * Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.

  • Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
  • Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
  • Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.
  • Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
  • Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
  • Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
  • Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance., JIRA Linux CI/CD DevOps Kibana Ansible Grafana Big Data Equities Indexing Logstash Dashboard Analytics OpenShift Bitbucket Confluent Pipelines Operations Management Automation Kubernetes Data Lakes Encryption Databricks Scalability Market Data Text Mining Apache NiFi Data Quality Apache Kafka Communication Observability Telecommuting Data Security Collaboration Apache Hadoop Virtual Teams Elasticsearch Data Recording Data Ingestion Data Pipelines Version Control Microsoft Azure Data Governance Data Validation Amazon Redshift Ancient History Computer Science Data Integration Business Metrics Data Warehousing Data Engineering Network Security Secret Clearance Agile Methodology CompTIA Security+ Data Architecture Query Performance Performance Metric Security Clearance Systems Integration Amazon Web Services Elastic (ELK) Stack User Interface (UI) Data Transformation User Experience (UX) Systems Architecture Intelligent Networks Business Intelligence Requirements Analysis Prometheus (Software) Technical Documentation Configuration Management SQL (Programming Language) IAT Level II Certification Snowflake (Data Warehouse) Java (Programming Language) Git (Version Control System) Extract Transform Load (ETL) Scrum (Software Development) Infrastructure as Code (IaC) React.js (Javascript Library) Python (Programming Language) Back End (Software Engineering) JavaScript (Programming Language) Configuration Management Databases Chef (Configuration Management Tool) Puppet (Configuration Management Tool) +0

Salesforce Developer Mid-Level Software Engineer Leidos

Saint Louis, MO*On-Site

JSON JIRA MySQL CI/CD Gitlab JQuery Ansible Jenkins Equities Terraform DevSecOps Pipelines Leadership Kubernetes PostgreSQL Opensearch Code Review Scalability Market Data RESTful API Multi-Cloud Spring Boot Data Access Microservices Secure Coding Self-Motivation Microsoft Azure Web Development Control Systems Sprint Planning Ancient History Computer Science Software Systems Containerization Front End Design Agile Methodology Docker (Software) CompTIA Security+ AWS CloudFormation Software Solutions Amazon Web Services User Interface (UI) Software Engineering Willingness To Learn Atlassian Confluence Programming Languages Emerging Technologies Flask (Web Framework) Cloud-Native Computing Full Stack Development Continuous Integration Django (Web Framework) Collaborative Software Angular (Web Framework) Geospatial Intelligence AWS Certified Developer Software Design Patterns Containerized Application SQL (Programming Language) Java (Programming Language) Vue.js (Javascript Library) Node.js (Javascript Library) Cascading Style Sheets (CSS) Infrastructure as Code (IaC) Amazon Elastic Compute Cloud React.js (Javascript Library) Python (Programming Language) Software Development Life Cycle Back End (Software Engineering) HyperText Markup Language (HTML) Iterative And Incremental Development Asynchronous Javascript and XML (AJAX) Application Programming Interface (API) Top Secret-Sensitive Compartmented Information (TS/SCI Clearance) +0

Google IT Automation with Python

Requirements

As a key Real-Time Visibility team member, you will be conducting design and implementation for a variety of solution capabilities to integrating various data sources into Confluent (Kafka) and Elastic platforms, design of robust data integration solutions, and adhering to the program’s CI/CD processes and data governance practices. You will an integral member of a fast paced, Agile development and implementation team to architect, design and develop data integration solutions (Extract, Transform, Load) to support a unified User Experience / User Interface (UX/UI) that provides a holistic single-pane-of-glass interface for an integrated solution on the Elastic platform. You will also work with operational end users and support teams to perform requirements analysis, as well as design, develop and demonstrate mockups and wireframes.

Candidate must be within driving distance of Scott AFB. At a minimum, a Secret clearance is required upon the start of employment and within 14 days following the start date the employee must obtain their Security + certification., * Bachelor’s degree in Computer Science, Engineering, or related technical discipline and 4+ years of relevant experience.

  • Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
  • Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
  • Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
  • Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
  • Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
  • Experience with Linux/UNIX system administration and automation.
  • Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
  • Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.
  • Strong communication and documentation skills for collaboration and knowledge sharing.
  • Must be able to commute to Scott AFB, IL for up to full-time onsite support.
  • Ability to obtain interim Secret DoD Security clearance before the start date.
  • Ability to obtain Security+ certification or equivalent DoD 8570 IAT II certification within 14 days of the start date., * Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.
  • Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack for text mining, summarization, search, and entity extraction.
  • Experience with cloud-based data platforms (AWS, Azure, GCP, AWS GovCloud), cloud-integrated platforms, and infrastructure as code, including networking and security policies.
  • Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic).
  • Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks.
  • Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence.
  • Certified Confluent Developer and Certified Elastic Engineer.
  • Excellent communication and collaboration skills, with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software, integration, and data engineering practices.
  • Apply knowledge of system architecture, networks, and centralized logging (ELK) to support data transformation initiatives.

If you’re looking for comfort, keep scrolling. At Leidos, we outthink, outbuild, and outpace the status quo - because the mission demands it. We’re not hiring followers. We’re recruiting the ones who disrupt, provoke, and refuse to fail. Step 10 is ancient history. We’re already at step 30 - and moving faster than anyone else dares., Telemetry ControlUp Operations Management Automation Mentorship Innovation ServiceNow Encryption Investments Derivatives Group Policy Fixed Income Communication Risk Analysis User Accounts Change Control Cyber Security Access Network Self-Motivation Microsoft Excel Microsoft Azure Computer Science Active Directory Event Management Virtual Desktops Security Controls Operating Systems Analytical Skills CompTIA Security+ Endpoint Security Device Management Visual Workplaces Project Management Windows PowerShell Wide Area Networks Building Consensus Root Cause Analysis Systems Integration Local Area Networks Network Engineering Endpoint Management Time Off Management Technical Leadership Systems Architecture System Administration Remote Access Systems Technology Assessment Information Technology Intellectual Curiosity Collaborative Software Unified Communications Technical Documentation Institutional Investing Configuration Management Microsoft Power Automate Virtual Private Networks (VPN) Cross-Functional Collaboration Microsoft Certified Professional Secure Remote Password Protocols Troubleshooting (Problem Solving) Microsoft Intune (Mobile Device Management Software) Microsoft 365 Certified Endpoint Administrator Associate +0

Benefits & conditions

Pay and benefits are fundamental to any career decision. That’s why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available at www.leidos.com/careers/pay-benefits .

About the company

Leidos is an industry and technology leader serving government and commercial customers with smarter, more efficient digital and mission innovations. Headquartered in Reston, Virginia, with 47,000 global employees, Leidos reported annual revenues of approximately $16.7 billion for the fiscal year ended January 3, 2025. For more information, visit www.Leidos.com .

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careercircle.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:33 min

Recapping vital capability shifts across security and enterprise infrastructure

Sergej Reznik Sergej Reznik · Europe 2026 Virtual

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:21 min

Projecting external HTML content using default and named slots

Rowdy Rabouw Rowdy Rabouw · WWC 2022

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

1:45 min

Transitioning from software development to security roles

Stefania Chaplin · WWC 2022

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all