Staff Software Engineer - Confluent Kafka Storage
IBM
Armonk, United States of America
4 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Armonk, United States of America
Tech stack
Java
Amazon Web Services (AWS)
Apache HTTP Server
Azure
C++
Software as a Service
Databases
Distributed Data Store
Distributed Systems
Fault Tolerance
Scala
Database Engines
Backend
Information Technology
Apache Flink
Kafka
Confluent
Go
Job description
As a Senior Staff Software Engineer on the Kora Storage team, you will serve as a key technical authority and architectural anchor. In this role, you will tackle deep systems-level challenges across state management, hardware optimization, disk/network I/O, and fault tolerance. Beyond architecting and implementing critical storage components, you will set technical standards, partner with leaders across the broader organization to shape our core roadmap, and mentor senior and junior engineers to foster a culture of technical excellence.
What You Will Do
- Storage Engine Development: Design and develop a highly available, performant, reliable, durable, scalable, and multi-tenant storage engine for Kora.
- Engineering Leadership: Set the standard for engineering excellence. Be instrumental in driving the technical solutions end-to-end, working closely with the team and key stakeholders to design, architect, and develop top-notch solutions.
- Cross-Functional Collaboration: Collaborate with product management, design, and other engineering teams to ensure seamless integration of storage features and infrastructure with the broader organization. Act as a trusted advisor for both internal and cross-functional teams, providing guidance on complex technical problems and contributing to high-level decision-making processes.
- Mentoring: Mentor engineers across the team and help shape the long-term technical direction.
Requirements
- 10+ years of relevant backend and/or infrastructure development experience.
- BS, MS, or PhD in computer science or a related field, or equivalent work experience
- Expertise in Java, Scala, C/C++, Go or other statically typed languages
- Proven experience designing and building large-scale, distributed storage systems.
- Deep knowledge of distributed systems concepts, including fault tolerance, consistency, and scalability.
- Solid understanding at a systems level (disk, network, operating systems, etc).
- Strong leadership skills with a demonstrated ability to mentor and guide engineers to success.
Preferred technical and professional experience
- A strong background in distributed storage systems or databases
- Expertise in building and operating modern cloud-based infrastructure and multi-tenant environments
- Experience developing SaaS services on public cloud providers (AWS, Azure or GCP)
- Familiarity with or has experience contributing to the following open-source technologies: Apache Kafka, Apache Iceberg, Apache Flink
- Interest in evangelism (giving talks at tech conferences, writing blog posts evangelizing your work)