Kafka Migration engineer ( .NET Kafka)

Kryptos Technologies Ltd
Charing Cross, United Kingdom
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 52K

Job location

Charing Cross, United Kingdom

Tech stack

.NET
API
User Authentication
C Sharp (Programming Language)
Serialization
JSON
Performance Tuning
Performance Testing
Event Driven Architecture
Avro
Kafka
Confluent

Job description

Migrate all Kafka producers and consumers from Kafka to Confluent Cloud

Update Confluent.Kafka .NET client configuration (SASL auth, Schema Registry, bootstrap servers)

Validate message flows end-to-end for apps acting as both producer and consumer

Ensure consumer group configurations, offset management, and error handling are correct post-migration

Kafka throughput validation and performance testing

Work with .NET engineers to resolve application-level Kafka integration issues

Requirements

Note: This role requires strong .NET skills in addition to Kafka expertise. All producers and consumers are .NET applications - APIs produce messages, and some services both consume and produce. This is not an infrastructure-only Kafka role; it requires reading, modifying, and validating .NET Kafka client code., C# / .NET - strong coding ability (reading and modifying producer/consumer code)

Confluent.Kafka .NET client library (ProducerBuilder, ConsumerBuilder, configuration)

Confluent Cloud - SASL/PLAIN authentication, Schema Registry, ACLs

Kafka internals: topics, partitions, consumer groups, offset management, rebalancing

Message serialization (Avro, JSON Schema) with .NET-specific serializers/deserializers

Troubleshooting Kafka connectivity and message flow issues in .NET applications

Kafka monitoring (consumer lag, throughput, error rates)

Nice to Have

Experience with apps that are both consumers and producers (event-driven architectures)

Schema evolution and compatibility strategies in Schema Registry

Performance tuning (batch size, compression) for .NET producers

Kafka Connect and MirrorMaker for migration scenari

Apply for this position