> Markdown version of [/jobs/ext/1441916-staff-software-engineer-observability](https://www.wearedevelopers.com/jobs/ext/1441916-staff-software-engineer-observability). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Staff Software Engineer - Observability

- **Company:** Intuit Inc.
- **Location:** Mountain View, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Amazon Web Services, Amazon S3, Cluster Analysis, Continuous Integration, Distributed Systems, Python (Programming Language), Software Engineering, System Programming, Data Logging, Network Routers, Indexer, Git, Information Technology, Splunk, Api Management, Golang
- **Published:** July 25, 2026
- **Apply:** https://dejobs.org/x/x/A5A04E9B5379433C91CD1C2FEC80E73B/job/

## About the Role

* 8-10+ years of software engineering experience, with significant experience designing and operating large-scale distributed systems/platforms
 * Bachelor's or Master's degree (BE/BTech/MS/MTech) in Computer Science, Engineering, or related field
 * Deep, architect-level knowledge and hands-on experience with Splunk (indexing, search architecture, clustering, KO management, REST/API integrations)
 * Strong experience building and operating splunk enterprise platform.
 * Proven track record leading platform cost-optimization initiatives at multi-petabyte/multi-million-dollar infrastructure scale
 * Experience with public cloud (AWS preferred) and on-premise hybrid deployments
 * Strong systems programming background (Java, Go, Python, or similar) and infrastructure-as-code / CI/CD practices
 * Experience driving automation and legacy system modernization efforts
 * Excellent cross-functional communication and technical leadership skills; ability to influence without direct authority
 * Prior experience in observability, SRE, or platform engineering roles strongly preferred

## Description

* Architect, design, and lead development of the O11y logging pipeline, including MCP Server, One Intuit Logging system, S3/Kinesis/CW Log Writers, Log Router, Fluent Bit DaemonSet, and OIL sidecar components
 * Own end-to-end Splunk platform architecture , indexer/search-head scaling, cluster topology (SBG, IP), ingestion architecture, and search performance at high-availability, high-scale (multi-PB/day) levels
 * Drive ingest-time cost optimization: field reduction, log-level filtering, sampling/aggregation, and routing of low-value data to cost-efficient storage (S3 + Federated Search)
 * Lead automation revamp/rewrite initiatives to modernize legacy pipeline tooling, reduce manual operational overhead, and improve deployment reliability
 * Define and enforce platform governance and guardrails for Knowledge Object creation (Splunk saved searches, dashboards) via Git-based CI/CD pipelines
 * Partner with SRE, platform, and BU teams to diagnose and resolve high-severity incidents related to logging pipeline and Splunk platform health
 * Provide technical leadership and mentorship across the O11y engineering team; set architectural direction and coding/design standards
 * Collaborate with leadership to translate cost-optimization and reliability roadmaps into engineering execution plans
 * Evaluate and integrate emerging technologies (e.g., GCP Logs Processor) to extend platform capabilities beyond Splunk


## Related Videos

- [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture)
- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Planet-Scale Dashboards](https://www.wearedevelopers.com/videos/1618-planet-scale-dashboards)
- [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang)
- [Next Level Enterprise Architecture: Modular, Flexible, Scalable, Multichannel and AI-Ready?](https://www.wearedevelopers.com/videos/1017-next-level-enterprise-architecture-modular-flexible-scalable-multichannel-and-ai-ready)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [How Much Does a Software Engineer Make? Realistic Software Engineering Salaries](https://www.wearedevelopers.com/magazine/425-how-much-does-a-software-engineer-make-realistic-software-engineering-salaries)
- [Software Engineer Career: Things You Should Know](https://www.wearedevelopers.com/magazine/143-software-engineer-career-things-you-should-know)
- [How to Answer the Interview Question: “Why Do You Want to Be a Software Engineer?”](https://www.wearedevelopers.com/magazine/392-how-to-answer-the-interview-question-why-do-you-want-to-be-a-software-engineer)
- [Highest Paying Tech Companies in Europe](https://www.wearedevelopers.com/magazine/162-highest-paying-tech-companies-in-europe)