Kafka Platform Engineer

Spectraforce
Austin, TX, United States
3 days ago
Apply on leoforce.us
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Automation of Tests Microsoft Azure Cloud Computing Code Generation Software Quality Continuous Integration Serialization DevOps Disaster Recovery Distributed Systems Protocol Buffers
+20 more
JSON Python (Programming Language) Systems Development Life Cycle Ansible Scripting Application Enhancement Tool Data Ingestion GitHub Copilot System Availability Multi-Agent Systems Prompt Engineering Build Management Avro Enterprise Integration Apache Kafka Database Replication Puppet Stream Processing Jenkins Confluent

Job description

  • Advise on data ingestion, event streaming, batch and stream processing architectures.
  • Provide guidance on data modeling and serialization standards (Avro, Protobuf, JSON Schema).
  • Support enterprise integration use cases and resolve complex Kafka related integration challenges.

AI Development

  • Design and build AI agents, custom skills, or equivalent frameworks to automate engineering and operational workflows at scale
  • Leverage AI-powered tools (e.g., Copilot, AI agents) to accelerate development, automate testing, improve code quality, and enable intelligent SDLC workflows aligned to AI-DLC vision.
  • Design agentic workflows and multi-agent orchestration patterns to solve complex distributed systems, integration, and operational challenges
  • Strong hands-on experience with GitHub Copilot and other AI-assisted development tools, including advanced prompt engineering and workflow integration to accelerate engineering
  • Proven ability to leverage AI-assisted development (e.g., Copilot, code generation) and build AI-driven agents/workflows to improve team productivity and engineering efficiency

Automation & DevOps Enablement

  • Drive automation first operations using Python, Ansible, and scripting.
  • Build and maintain self service operational tools to reduce day to day support overhead.
  • Integrate Kafka platform operations with DevOps and CI/CD tooling (e.g., Azure, Jenkins, Puppet, Chef).

Incident Management & Problem Resolution

  • Lead deep dive investigations into complex production issues and outages.
  • Perform root cause analysis, document findings, and drive remediation to closure.
  • Operate effectively in high pressure outage and incident management scenarios.

Advisory & Stakeholder Engagement

  • Act as a trusted technical advisor to Schwab engineering, operations, and leadership teams.
  • Communicate complex technical concepts clearly to both technical and non technical stakeholders.
  • Demonstrate strong customer focus, ownership, and onshore engagement.
  • Collaborate effectively with cross functional teams and vendors.

Requirements

Experience with Confluent Kafka Platform Experience with both On-Prem and Cloud Must have experience leveraging AI powered tools and building AI driven agentsls as it relates to

  • Design and implement secure Kafka architectures, including authentication, authorization, encryption, and network isolation.
  • Define and support high availability, disaster recovery, and data replication strategies.
  • Ensure alignment with enterprise security, compliance, and governance standards., * 10+ years of experience in distributed systems, messaging, and enterprise platform engineering.
  • Extensive hands on experience with Confluent Kafka Platform (on prem and cloud).
  • Strong background in Linux/Unix environments, networking, OS performance, and security.
  • Proven experience with automation, DevOps, and operational tooling.
  • Experience leveraging AI powered tools to accelerate development and improve team productivity and efficiency
  • Excellent written and verbal communication skills.
  • Strong organizational, relationship management, and teamwork skills.

Preferred Qualifications

  • Confluent Kafka and/or Cloud certifications.
  • Prior experience supporting large scale, regulated enterprise environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on leoforce.us
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:26 min

Understanding Puppeteer and its underlying architectural design

Miki Lombardi · JS Congress

3:02 min

Audience Q&A on data formats and engine tradeoffs

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

3:55 min

Infrastructure challenges when combining Kafka with Apache Flink

Bobur Umurzokov · LIVE

4:01 min

Comparing Terraform to popular configuration management tools

Devlin Duldulao · LIVE

2:03 min

Distinguishing type definition constructs from data validation routines

Clemens Vasters Clemens Vasters · World Congress 2025

Videos

See all

Related articles

See all