Kafka Platform Engineer
Spectraforce
Austin, TX, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on leoforce.us
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Automation of Tests
Microsoft Azure
Cloud Computing
Code Generation
Software Quality
Continuous Integration
Serialization
DevOps
Disaster Recovery
Distributed Systems
Protocol Buffers
+20 more
JSON
Python (Programming Language)
Systems Development Life Cycle
Ansible
Scripting
Application Enhancement Tool
Data Ingestion
GitHub Copilot
System Availability
Multi-Agent Systems
Prompt Engineering
Build Management
Avro
Enterprise Integration
Apache Kafka
Database Replication
Puppet
Stream Processing
Jenkins
Confluent
Job description
- Advise on data ingestion, event streaming, batch and stream processing architectures.
- Provide guidance on data modeling and serialization standards (Avro, Protobuf, JSON Schema).
- Support enterprise integration use cases and resolve complex Kafka related integration challenges.
AI Development
- Design and build AI agents, custom skills, or equivalent frameworks to automate engineering and operational workflows at scale
- Leverage AI-powered tools (e.g., Copilot, AI agents) to accelerate development, automate testing, improve code quality, and enable intelligent SDLC workflows aligned to AI-DLC vision.
- Design agentic workflows and multi-agent orchestration patterns to solve complex distributed systems, integration, and operational challenges
- Strong hands-on experience with GitHub Copilot and other AI-assisted development tools, including advanced prompt engineering and workflow integration to accelerate engineering
- Proven ability to leverage AI-assisted development (e.g., Copilot, code generation) and build AI-driven agents/workflows to improve team productivity and engineering efficiency
Automation & DevOps Enablement
- Drive automation first operations using Python, Ansible, and scripting.
- Build and maintain self service operational tools to reduce day to day support overhead.
- Integrate Kafka platform operations with DevOps and CI/CD tooling (e.g., Azure, Jenkins, Puppet, Chef).
Incident Management & Problem Resolution
- Lead deep dive investigations into complex production issues and outages.
- Perform root cause analysis, document findings, and drive remediation to closure.
- Operate effectively in high pressure outage and incident management scenarios.
Advisory & Stakeholder Engagement
- Act as a trusted technical advisor to Schwab engineering, operations, and leadership teams.
- Communicate complex technical concepts clearly to both technical and non technical stakeholders.
- Demonstrate strong customer focus, ownership, and onshore engagement.
- Collaborate effectively with cross functional teams and vendors.
Requirements
Experience with Confluent Kafka Platform Experience with both On-Prem and Cloud Must have experience leveraging AI powered tools and building AI driven agentsls as it relates to
- Design and implement secure Kafka architectures, including authentication, authorization, encryption, and network isolation.
- Define and support high availability, disaster recovery, and data replication strategies.
- Ensure alignment with enterprise security, compliance, and governance standards., * 10+ years of experience in distributed systems, messaging, and enterprise platform engineering.
- Extensive hands on experience with Confluent Kafka Platform (on prem and cloud).
- Strong background in Linux/Unix environments, networking, OS performance, and security.
- Proven experience with automation, DevOps, and operational tooling.
- Experience leveraging AI powered tools to accelerate development and improve team productivity and efficiency
- Excellent written and verbal communication skills.
- Strong organizational, relationship management, and teamwork skills.
Preferred Qualifications
- Confluent Kafka and/or Cloud certifications.
- Prior experience supporting large scale, regulated enterprise environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on leoforce.us
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
CH
Chris Heilmann
about 2 years ago
IK
Igor Khokhriakov
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
about 2 months ago
MH
Michael Hunger
Everything a Developer Needs to Know About MCP with Neo4j
about 1 year ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
EF
Elizabeth Fuentes Leone, AWS Developer Advocate, GenAI
From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path
10 months ago
CS
Christina Schaireiter
Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence
4 months ago