Kafka Developer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+34 more
Job description
We are seeking an experienced Kafka Developer to design, develop, and support real-time, event-driven data streaming solutions using Apache Kafka. The ideal candidate will have expertise in distributed messaging systems, stream processing, data integration, and microservices architectures. This role will be responsible for building scalable, high-performance streaming platforms that enable real-time data exchange across enterprise applications and cloud environments., Kafka Development & Streaming Solutions
- Design, develop, and maintain real-time data streaming solutions using Apache Kafka.
- Build Kafka Producers, Consumers, and Streams applications.
- Develop event-driven architectures to support enterprise integration and data processing needs.
- Implement scalable and fault-tolerant messaging solutions.
Platform Engineering
- Configure and manage Kafka topics, partitions, replication, and retention policies.
- Monitor Kafka cluster performance and optimize throughput, latency, and reliability.
- Manage schema evolution using Schema Registry and Avro.
- Ensure high availability and disaster recovery configurations.
Data Integration
- Develop integrations between Kafka and enterprise systems, including Salesforce, MuleSoft, Databricks, Snowflake, SAP, and cloud platforms.
- Implement Kafka Connect for source and sink integrations.
- Support batch-to-real-time modernization initiatives.
- Build event streaming pipelines for operational and analytical workloads.
Stream Processing
- Develop real-time processing applications using Kafka Streams, Apache Flink, and Apache Spark Streaming.
- Implement event filtering, transformation, aggregation, and enrichment logic.
- Support low-latency, high-volume data processing requirements.
DevOps & Monitoring
- Automate deployment processes using CI/CD pipelines.
- Implement monitoring and alerting using Prometheus, Grafana, Splunk, or ELK Stack.
- Troubleshoot and resolve production issues.
- Perform capacity planning and cluster optimization.
Security & Governance
- Implement Kafka security using SSL/TLS, SASL, RBAC, and authentication mechanisms.
- Ensure compliance with enterprise security and governance standards.
- Manage data retention and data protection policies.
Requirements
- Bachelorβs degree in Computer Science, Information Systems, Engineering, or a related field.
- 4+ years of software development experience.
- 3+ years of hands-on Apache Kafka development experience.
- Strong understanding of distributed systems and event-driven architectures.
- Experience building enterprise-scale streaming solutions.
Required Technical Skills
Streaming Technologies
- Apache Kafka
- Kafka Streams
- Kafka Connect
- Confluent Platform
- Schema Registry
- Apache ZooKeeper (or KRaft)
Programming Languages
- Java
- Python
- Scala (preferred)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦