Kafka Platform Engineer

We are seeking an experienced Kafka Platform Engineer with expertise in Apache Kafka, Confluent Cloud, Azure, and event-driven architecture. The ideal candidate will design, implement, and support enterprise Kafka platforms, build scalable streaming solutions, automate infrastructure, and ensure platform reliability, security, and performance., * Design and implement Confluent Cloud environments across Development, QA, UAT, and Production.

• Configure and manage Kafka clusters, topics, partitions, replication, and retention policies.
• Establish Kafka platform standards, naming conventions, and deployment procedures.
• Implement multi-region architecture and disaster recovery strategies.
• Integrate applications, databases, cloud services, and enterprise systems with Kafka.
• Configure and manage Confluent Cloud Connectors.
• Implement event-driven architecture and streaming integration solutions.
• Monitor Kafka platform health, throughput, consumer lag, and broker utilization.
• Troubleshoot producer, consumer, and connectivity issues.
• Configure operational dashboards, alerts, and monitoring solutions.
• Perform platform upgrades, performance tuning, and capacity planning.
• Automate Kafka infrastructure deployment using Terraform.
• Integrate Kafka deployments with CI/CD pipelines.
• Collaborate with architects, cloud engineers, integration teams, and business stakeholders.
• Participate in technical design reviews and architecture discussions., Job Title: Principal Engineer II - Digital Banking Platform Location: OH - Columbus What you’ll do: As a Principal Engineer, you will serve as a hands-on technical leader acros…
• 10 days ago +

• Strong experience with Apache Kafka administration and architecture.
• Hands-on experience with Confluent Cloud.

• Experience with:

• Kafka Producers & Consumers
• Kafka Connect
• Schema Registry
• Stream Governance
• Topic Design & Partitioning Strategies
• Experience with Microsoft Azure.
• Knowledge of REST APIs, Event-Driven Architecture, Microservices, and Data Streaming.

• Strong understanding of Kafka security:

• SASL/SSL
• OAuth
• RBAC
• API Key Management
• Experience with Terraform and Infrastructure as Code (IaC).
• Experience with GitHub, GitLab, Azure DevOps, and CI/CD pipelines.
• Strong troubleshooting, performance tuning, and capacity planning skills.

Preferred Skills:

• Experience with enterprise-scale Kafka deployments.
• Multi-region Kafka architecture and disaster recovery.
• Strong communication, collaboration, and stakeholder management skills.
• Experience with cloud-native integration platforms and distributed systems.