Site Reliability Engineer
Role details
Job location
Tech stack
Job description
The NMCI Service Management Integration and Transport (SMIT) group at Leidos has an opening for a Site Reliability Engineer to focus on the reliability, performance, and scalability of complex distributed systems. Under the SMIT Contract, the Leidos team is responsible for the core backbone for the Navy-Marine Corps Intranet, including cybersecurity services, network operations, network engineering, service desk, seat support services, and data transport.
The SRE will also develop and execute tests focused on system resilience, performance under load, and failure scenarios. They will work in tandem with other Site Reliability Engineers (SREs) and development teams to create automated testing frameworks that simulate real-world conditions that validate system behavior under normal and stress conditions, ensuring our services are resilient and meet established service level objectives (SLOs). Your work will contribute to the development of robust and scalable services that operate reliably in production.
Your responsibilities will include maintaining complex computer systems by writing code to automate software releases, monitor systems, and detect and fix problems before users even know there is an issue. You will use these skills to improve site performance and overall reliability.
The SRE Engineer role is responsible for supporting, migrating, automation and optimization of software development and deployment process, infrastructure as code, and contribute to the overall maturity of the Site Reliability Engineering program.
Primary Responsibilities
-
Work alongside the development and operations teams to ensure speedy and reliable software deployments, monitor systems, and improve overall reliability of the platform. In addition, as you discover and document system bugs, you have the motivation to go off and fix them yourself.
-
Develop features utilize the AI coding tool and repository of scripts to automate, scale, test, and secure the cloud infrastructure and the pipelines.
-
Enhance performance monitoring of the various systems via Splunk or other dashboard reporting tools
-
Identify performance bottlenecks and optimize the performance of cloud infrastructure
-
Contribute to continuing our SRE journey by suggesting ways to improve engineering build, maintenance, automation and reliability across the platform with SRE/DevOps tools and Infrastructure-as-Code.
-
Develop and code high-quality pipeline automation workflows to support inside and outside the cloud platform that are appropriate for business and technology strategies.
-
Develop and execute test strategies that simulate real-world failure scenarios, including network disruptions, hardware failures, and system overloads.
-
Create, script, and run performance tests to measure system behavior under varying levels of load and traffic. Identify bottlenecks, performance degradation, and areas for optimization.
-
Design, implement, and maintain automated test suites for infrastructure and application components. Ensure that testing is integrated into the CI/CD pipeline to validate system reliability with every release.
-
Build automated systems for continuous performance testing, stress testing, and load testing.
-
Work closely with SREs, developers, and operations teams to define reliability goals and develop appropriate testing strategies to validate those goals.
-
Ensure that new services and features undergo thorough testing for performance, reliability, and failure recovery before deployment to production.
-
Validate that monitoring, logging, and alerting mechanisms are functioning correctly by testing systems under failure conditions.
-
Ensure that Service Level Indicators (SLIs) and Service Level Objectives (SLOs) are accurately measured and tracked through automated testing frameworks.
-
Resolve most conflicts between timeline, budget, and scope independently but intuitively raise sophisticated or consequential issues to senior management, On-Site Operations Workflow Management Management Automation Cyber Security Dashboard Debugging Python (Programming Language) Test Automation Scalability Innovation Software Development Agile Methodology Scripting Reliability Risk Management Framework Resilience Microsoft Azure Linux Intranet DevOps Windows PowerShell Bash (Scripting Language) Amazon Web Services CI/CD Puppet (Configuration Management Tool) Chef (Configuration Management Tool) Reporting Tools Ansible Terraform Splunk Kubernetes Docker (Software) Platform As A Service (PaaS) Cloud Infrastructure Artificial Intelligence Service Level Security Clearance Scrum (Software Development) Jenkins Unix JIRA Gitlab Site Reliability Engineering Infrastructure as Code (IaC) OpenShift Market Data Equities Virtual Teams Network Engineering Bitbucket Azure DevOps Service Management IAT Level II Certification DevSecOps Atlassian Confluence Secret Clearance Load Testing Secret Internet Protocol Router Network (SIPRNet) Command-Line Interface Performance Testing AWS CloudFormation Data Transport Utility Service Level Objectives Software Stress Testing Support Services Ancient History
Requirements
-
Requires BS degree and with 4+ years of prior relevant experience or equivalent experience to substitute for education.
-
Although technically a remote position, requires ability of candidate to travel locally to a Navy NMCI facility to access the Navy's classified Network.
-
Currently possess and ability to maintain an active DoD Secret security clearance
-
Minimum of DoD 8570.01 IAT Level II Certification required and must maintain certification while supporting the SMIT Contract
-
Must be able to support program execution in classified environments and access SIPRNet from an NMCI location on short notice (local travel).
-
Experience with automated script design, coding, debugging, and maintenance skills (using bash, python, etc.) preferred
-
Experience in CI/CD toolsets (e.g. Jenkins, GitLab, etc.)
-
Good command of Linux/Unix and command line knowledge
-
Experience in application administration, configuration, and integration
-
Familiarity with agile development methodologies
-
Skilled and disciplined to work with a distributed team
-
Ability to work in a highly collaborative, forward thinking, and innovation-driven environment
-
Knowledge of Agile and DevSecOps/SRE concepts and best practices, with a desire to grow that knowledge
-
Hand-on experience with Atlassian products (Jira, Confluence, Bitbucket, etc.).
-
Experience creating JIRA and/or Azure DevOps workflows, projects, custom configurations
-
Experience administrating/maintaining SRE platform via Ansible playbooks (e.g. upgrading Jenkins)
-
Experience in automating tasks with scripting languages like PowerShell, or Python
-
Integrating/maintaining with various 3rd party CI/CD tools like Jenkins and Gitlab.
-
Experience with PaaS using Red Hat OpenShift/Kubernetes and Docker containers
-
Experience with commercial cloud infrastructure deployment environments such as AWS and Azure.
-
Experience with automated provisioning and configuration tools like Terraform, Cloud Formation, Chef, Puppet, Ansible, or similar technologies.
-
Working knowledge of the Risk Management Framework (RMF), DISA STIGs
Preferred Qualifications:
-
Previous work experience providing support to the NGEN-NMCI program
-
Experience with Infrastructure as Code (IaC) tools such as Terraform, Ansible, or CloudFormation for automating test environments.
-
ITILv4, Scrum Master, or Agile SAFe certification(s) or applicable experience
Key Metrics of Success for the Team:
-
Improved system reliability, as measured by adherence to Service Level Objectives (SLOs) and reduced Mean Time to Recovery (MTTR).
-
Comprehensive and regularly updated automated test coverage for all critical systems and infrastructure components.
Benefits & conditions
Pay and benefits are fundamental to any career decision. That's why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available at www.leidos.com/careers/pay-benefits .