Kafka Platform Engineer
Role details
Job location
Tech stack
Job description
We are seeking an experienced Kafka Platform Engineer with expertise in Apache Kafka, Confluent Cloud, Azure, and event-driven architecture. The ideal candidate will design, implement, and support enterprise Kafka platforms, build scalable streaming solutions, automate infrastructure, and ensure platform reliability, security, and performance., * Design and implement Confluent Cloud environments across Development, QA, UAT, and Production.
- Configure and manage Kafka clusters, topics, partitions, replication, and retention policies.
- Establish Kafka platform standards, naming conventions, and deployment procedures.
- Implement multi-region architecture and disaster recovery strategies.
- Integrate applications, databases, cloud services, and enterprise systems with Kafka.
- Configure and manage Confluent Cloud Connectors.
- Implement event-driven architecture and streaming integration solutions.
- Monitor Kafka platform health, throughput, consumer lag, and broker utilization.
- Troubleshoot producer, consumer, and connectivity issues.
- Configure operational dashboards, alerts, and monitoring solutions.
- Perform platform upgrades, performance tuning, and capacity planning.
- Automate Kafka infrastructure deployment using Terraform.
- Integrate Kafka deployments with CI/CD pipelines.
- Collaborate with architects, cloud engineers, integration teams, and business stakeholders.
- Participate in technical design reviews and architecture discussions., Job Title: Principal Engineer II - Digital Banking Platform Location: OH - Columbus What you'll do: As a Principal Engineer, you will serve as a hands-on technical leader acros…
- 10 days ago
Requirements
-
Strong experience with Apache Kafka administration and architecture.
-
Hands-on experience with Confluent Cloud.
-
Experience with:
-
Kafka Producers & Consumers
-
Kafka Connect
-
Schema Registry
-
Stream Governance
-
Topic Design & Partitioning Strategies
-
Experience with Microsoft Azure.
-
Knowledge of REST APIs, Event-Driven Architecture, Microservices, and Data Streaming.
-
Strong understanding of Kafka security:
-
SASL/SSL
-
OAuth
-
RBAC
-
API Key Management
-
Experience with Terraform and Infrastructure as Code (IaC).
-
Experience with GitHub, GitLab, Azure DevOps, and CI/CD pipelines.
-
Strong troubleshooting, performance tuning, and capacity planning skills.
Preferred Skills:
- Experience with enterprise-scale Kafka deployments.
- Multi-region Kafka architecture and disaster recovery.
- Strong communication, collaboration, and stakeholder management skills.
- Experience with cloud-native integration platforms and distributed systems.