> Markdown version of [/jobs/ext/4623513-senior-splunk-itsi-engineer](https://www.wearedevelopers.com/jobs/ext/4623513-senior-splunk-itsi-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Splunk ITSI Engineer - **Company:** Olympus - **Location:** Washington, DC, United States - **Experience:** Expert - **Salary:** $165,500 - $195,000 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Data Analysis, Systems Engineering, Audit Trail, Microsoft Azure, Bash Shell, Cloud Computing, Information Systems, Identity and Access Management, Information Model, Information Technology Operations, Python (Programming Language), Linux System Administration, Machine Learning, Oracle (Applications), Ping (Networking Utility), Public Key Infrastructure, Role-Based Access Control, Zero Trust Network Access, Systems Integration, User-Centered Design, Scripting, Cloud Platform System, Okta, Data Ingestion, Cyberark, Information Technology, SailPoint, Splunk, AIOps, Servicenow - **Published:** November 7, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-splunk-itsi-engineer-washington-dc--37631898-27df-4266-a2f3-302c26e66744 ## About the Role Splunk, Splunk, Performance Metrics, Technical Support, Government Contracts, Government, Incident Response, Sensitive Compartmented Information (SCI), Top Secret Clearance, United States Citizen, Olympus Solutions, Inc. is seeking a Full-Time, highly motivated Senior Splunk ITSI Engineer to own the service intelligence layer of a federal customer's Splunk environment. In this hands-on engineering role, you will model mission and IT services in Splunk IT Service Intelligence (ITSI), design the KPIs and thresholds behind service health scores, tune event analytics so operators see real problems instead of noise, and keep a search-heavy ITSI deployment performing. You will serve as the customer's primary ITSI subject matter expert, working onsite with government and contractor operations staff., * Active TS/SCI security clearance. Olympus will not sponsor an initial clearance for this position. * U.S. citizenship. * 8+ years of IT operations, systems engineering, or monitoring engineering experience, including 5+ years of hands-on Splunk engineering. * 2+ years building and operating Splunk ITSI in production, including service modeling, KPI design, and event analytics, not just consuming dashboards built by others. * Strong Search Processing Language (SPL) skills, including base searches, data model acceleration, and search optimization. * Linux administration and scripting (Python, Bash) in support of Splunk. * Experience integrating Splunk with an ITSM platform (ServiceNow preferred). * Bachelor's degree in Computer Science, Information Systems, or a related field, or four additional years of relevant experience in lieu of a degree., * Splunk ITSI Certified Admin. * Splunk Enterprise Certified Admin or Splunk Enterprise Certified Architect. * Experience with Splunk Enterprise Security or Splunk Observability Cloud and how each interoperates with ITSI. * Experience supporting DoD, Intelligence Community, or federal civilian operations centers. * Working knowledge of ITIL service management and AIOps concepts. * Experience running Splunk on AWS GovCloud or Azure Government. * DoD 8140 baseline certification (Security+ or higher). ## Description * Schedule - Standard business hours, with occasional after-hours support for upgrades and incident response. * Travel - Minimal. * Employment - Full-time, exempt. * Salary Range - $165,000 to $195,000 annually. Placement within the range depends on depth of ITSI experience, Splunk certifications, and overall qualifications. * Clearance and Eligibility - Active TS/SCI required at time of application. Olympus will not sponsor an initial clearance for this position. U.S. citizenship required., Service Modeling and KPI Design * Design, build, and maintain ITSI service trees, including service decomposition, entity definition and discovery, dependency mapping, and service templates. * Develop KPIs and shared KPI base searches, and configure static and adaptive (machine learning) thresholds, time policies, and health score weighting. * Create and maintain glass tables, deep dives, and service analyzer views for NOC, operations, and executive audiences. Event Analytics and Data Onboarding * Build and tune event analytics, including correlation searches, notable event aggregation policies, episode review workflows, and ITSM integration (ServiceNow or equivalent) for ticketing. * Onboard and normalize data sources feeding ITSI, including Common Information Model (CIM) compliance, entity enrichment, and content pack deployment. Platform Performance and Administration * Monitor and tune ITSI performance, including search scheduler load, KPI search concurrency, backfill, and summary index health. * Administer the underlying Splunk Enterprise or Splunk Cloud platform as needed, including search head and indexer configuration, apps and add-ons, role-based access control, and version upgrades. * Support the security posture of the environment, including STIG application, audit logging, and change management. Documentation and Leadership * Document service models, KPI definitions, runbooks, and standard operating procedures, and brief government stakeholders on service health and monitoring maturity. * Mentor junior Splunk staff and provide technical direction on monitoring strategy., * Consulting and Technical Advisement - Expert guidance on best practices, Federal compliance, and strategic planning for identity and PKI system designs, upgrades, and implementations. * System Security Engineering (SSE) - Building secure systems that oversee and safeguard critical infrastructure, with automated controls and emergency procedures built in. * Design and Implementation - End-to-end design and implementation of ICAM, PKI, and PAM systems, with a focus on Zero Trust identity pillar solutions. * System Upgrades and Legacy Integration - Upgrading complex enterprise systems, including mainframe-era applications, with no unscheduled downtime. * Operations, Maintenance, and Sustainment - Continuous optimization of customer systems to improve performance, efficiency, and security posture. Olympus engineers work across leading identity and security platforms including SailPoint, CyberArk, BeyondTrust, Okta, Oracle IAM, EntraID, Ping Federate, Radiant Logic, KeyFactor, AppViewX, and others. We are committed to delivering measurable outcomes for our customers while investing in the growth, development, and success of our team.