Senior Elastic Stack Data Integration Engineer IRES - SSFB/HSV
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+37 more
Job description
The Senior Elastic Stack Data Integration Engineer will serve as the primary technical authority for designing, building, and maintaining data ingestion pipelines supporting Elastic SIEM. This role focuses on creating scalable, resilient Logstash architectures; developing advanced pipeline logic; normalizing, enriching, and transforming security telemetry; and ensuring reliable delivery of high-fidelity data to Elasticsearch., * Architect, build, and maintain Logstash pipelines to ingest and transform logs from diverse systems, including network devices, servers, cloud services, and security platforms.
- Implement parsing, grok patterns, JSON transformations, conditional routing, enrichment logic, and ECS mapping.
- Optimize pipeline performance, resiliency, and scalability (e.g., persistent queues, pipeline workers, memory tuning, load balancing).
- Ensure all ingested data aligns to ECS (Elastic Common Schema) or internal schema requirements.
- Implement data enrichment workflows (GeoIP, threat intel lookups, metadata injection).
- Validate data completeness, integrity, and fidelity across ingestion flows.
- Maintain and optimize Logstash clusters, including version management, scaling, tuning, and high-availability configurations.
- Manage integrations with Beats, Elastic Agent, Kafka, syslog endpoints, and custom data collectors.
- Monitor ingestion throughput, latency, and error rates; implement proactive alerting and troubleshooting processes.
- Create and maintain technical documentation, including pipeline diagrams, data flow maps, runbooks, and schema references.
- Establish enterprise standards for parsing, enrichment, normalization, and ingestion patterns.
- Support internal and external audits by documenting data handling flows and pipeline logic.
- Work closely with SIEM integration engineers to align pipelines with customer environments and logging requirements.
- Partner with detection engineering teams to ensure data supports analytic coverage and rule development.
- Collaborate with infrastructure and platform operations for deployment, scaling, and reliability engineering.
Requirements
- Deep command of Logstash architecture, patterns, and performance optimization.
- Mastery of parsing, enrichment, normalization, and ECS alignment.
- Strong understanding of network protocols, logging patterns, and telemetry generation from enterprise systems.
- Advanced troubleshooting skills across data ingestion, pipeline logic, and Elastic Stack processing layers.
- Capability to design scalable, HA ingestion workflows with clear operational boundaries.
- Ability to conduct data modeling, schema design, and transformation mapping.
- Effective at interfacing with multiple teams, gathering requirements, and aligning pipeline designs with SIEM analytics needs.
- Focused on reliability, maintainability, and observability across all pipeline components.
-
Strong attention to detail and a disciplined approach to documentation, versioning, and configuration management.
- Demonstrated ability to work independently, drive pipeline architecture decisions, and mentor junior engineers.
- Strong documentation, workflow diagramming, and communication skills.
Resumes, in month and year format, must be submitted with application in order to be considered for the position. The selected candidate may be assigned as an employee for one of our teammate companies.
Basic Requirements:
- Must have 4, or more, years of general (full-time) work experience
- May be reduced with completion of advanced education
- Must have 3, or more, years of directly related experience in log ingestion, data engineering, or SIEM pipeline development.
- Must have 2, or more, years of experience working in a management or leadership role
- Must have a strong background in Elastic Stack components (Elasticsearch, Kibana, Beats, Elastic Agent).
- Must have experience with data ingestion, processing, and enrichment techniques.
- Must have hands-on experience ingesting, processing, and normalizing diverse log types (Windows events, syslog, firewall logs, cloud telemetry, security tooling).
- Must be proficient with Linux administration, system-level debugging, and CLI-based operations.
- Must have a DoD 8570.01-M IAT Level II certification with Continuing Education (CE) - (CCNA-Security, CySA+, GICSP, GSEC, Security+ CE, CND, SSCP)
- Must have an active DoW Secret Security Clearance
- Must be able to obtain, and maintain, a DoW Top Secret Security Clearance
Desired Requirements:
- Be an Elastic Certified Engineer or have relevant Elastic Stack certifications.
- Have strong experience integrating Kafka, Redis, or other message bus technologies into ingestion workflows.
- Have scripting proficiency in Python, Bash, or PowerShell for automation and data validation.
- Have experience designing geo-distributed or multi-cluster ingestion architectures.
- Have knowledge of threat intelligence ingestion, correlation data enrichment, and advanced ECS mapping.
- Have experience with CI/CD pipelines, GitOps workflows, or Infrastructure-as-Code (Terraform, Ansible).
- Be familiar with data quality assurance frameworks and pipeline testing methodologies.
- Have knowledge of cloud-native logging architectures (AWS Firehose, Azure Event Hub, GCP Logging).
This position will be posted for a minimum of 3 days. If a candidate has not been selected at that time, it will continue to be posted until a suitable candidate is selected or the position is closed.
Benefits & conditions
Our health and welfare benefits are designed to support you and your priorities. Offerings include:
- Health, dental, and vision insurance
- Paid time off and holidays
- Retirement benefits (including 401(k) matching)
- Educational reimbursement
- Parental leave
- Employee stock purchase plan
- Tax-saving options
- Disability and life insurance
- Pet insurance
Note: Benefits may vary based on employment type, location, and applicable agreements. Positions governed by a Collective Bargaining Agreement (CBA), the McNamara-O’Hara Service Contract Act (SCA), or other employment contracts may include different provisions/benefits.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Find a Developer Job: 12 Best Job Sites For Developers
Fully Remote Software Engineer Jobs
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
Where To Find Software Engineering Jobs