Kafka Developer / Consultant (Event-Driven Integration)

DTI
Columbus, United States of America
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 208K

Job location

Remote
Columbus, United States of America

Tech stack

Java
API
Amazon Web Services (AWS)
User Authentication
Azure
Cloud Computing
Information Systems
Software Debugging
DevOps
Distributed Systems
Middleware
Fault Tolerance
Protocol Buffers
Monitoring of Systems
JSON
Python
Performance Tuning
Message Oriented Middleware
Salesforce
SAP Applications
Software Engineering
Data Streaming
Systems Integration
WebRTC
Enterprise Application Integration
Transport Layer Security
Google Cloud Platform
Enterprise Software Applications
System Availability
Software Troubleshooting
SAP Business Technology Platform
Event Driven Architecture
Information Technology
Avro
Enterprise Integration
Kafka
Operational Systems
Event Sourcing
REST
Stream Processing
Data Pipelines
Mulesoft
Confluent
Programming Languages

Job description

We are seeking a highly skilled Kafka Developer / Consultant to support a multi-year CIS transformation program for our public utility client in Columbus, Ohio. This role will be responsible for designing, developing, and supporting scalable event-driven integration solutions using Apache Kafka to enable real-time communication between SAP, CIS, and enterprise utility systems., * Design and develop event-driven architectures using Apache Kafka (Producers, Consumers, Topics, Streams)

  • Build and manage real-time data pipelines and streaming integrations supporting the CIS transformation program
  • Configure and optimize Kafka clusters, topics, partitions, replication strategies, and retention policies
  • Develop Kafka-based integration solutions across SAP, CIS, and enterprise utility systems
  • Implement event-streaming patterns including publish/subscribe, event sourcing, and asynchronous messaging
  • Ensure scalability, reliability, fault tolerance, and high availability of Kafka-based solutions
  • Integrate Kafka with middleware and enterprise integration platforms including SAP BTP Integration Suite, MuleSoft, Azure APIs, and related technologies
  • Design and support real-time event-driven integrations between customer, billing, metering, and operational systems
  • Monitor and troubleshoot Kafka environments using Confluent Control Center and related monitoring tools
  • Collaborate with architects, business analysts, integration teams, and stakeholders to translate business requirements into technical solutions
  • Contribute to architecture design, technical documentation, error handling strategies, and integration best practices
  • Support SIT, UAT, deployment, cutover, and production support activities
  • Participate in enterprise integration governance and architecture review activities

Requirements

The ideal candidate will have hands-on experience building event-driven architectures, real-time data streaming solutions, distributed systems, and enterprise integration platforms. This individual will play a critical role in modernizing the utility technology landscape by enabling high-volume, resilient, and scalable integrations across customer, billing, metering, asset management, and operational systems., * Bachelor''s degree in Computer Science, Information Systems, Engineering, or related field

  • 4+ years of software development and integration experience
  • Hands-on experience with Apache Kafka including design, development, configuration, and administration
  • Strong understanding of:
  • Event-Driven Architecture (EDA)
  • Distributed systems
  • Asynchronous messaging
  • Real-time streaming architectures
  • Experience building:
  • Kafka Producers and Consumers
  • Topic design and partitioning strategies
  • Event streaming solutions
  • Proficiency in one or more programming languages:
  • Java
  • Scala
  • Python
  • Experience with REST APIs and enterprise integration patterns
  • Strong troubleshooting, debugging, and performance tuning skills
  • Experience supporting enterprise integration testing and deployment activities

Preferred Qualifications

  • Experience with Confluent Kafka Platform including:
  • Schema Registry
  • Kafka Connect
  • KSQL
  • Confluent Control Center
  • Experience with SAP BTP Integration Suite
  • Experience integrating Kafka with enterprise platforms such as:
  • SAP
  • Salesforce
  • CIS platforms
  • Utility applications
  • Experience with Azure APIs, MuleSoft, or other enterprise middleware solutions
  • Cloud platform experience with AWS, Azure, or Google Cloud Platform Kafka services
  • Familiarity with DevOps and CI/CD tools
  • Understanding of:
  • SSL
  • SASL
  • Authentication and Authorization
  • Avro
  • JSON
  • Protobuf

Preferred Utility Experience

  • Public utility industry experience strongly preferred
  • Experience supporting Customer Information Systems (CIS) transformations
  • Knowledge of utility business processes including:
  • Customer Service
  • Billing
  • Metering
  • Work Management
  • Asset Management
  • Field Operations
  • Experience supporting large-scale utility modernization programs

Soft Skills

  • Strong analytical and problem-solving skills
  • Excellent communication and stakeholder management abilities
  • Ability to work effectively in a fast-paced, collaborative environment
  • Self-driven with an architect mindset for enterprise-grade solutions
  • Ability to communicate effectively with both technical and business audiences

Typical Use Cases the Role Will Support

  • Event-driven integration between SAP and external systems
  • Real-time customer and service event streaming
  • High-volume asynchronous data processing pipelines
  • Enterprise publish/subscribe messaging architectures
  • Real-time integration between CIS, SAP, metering, billing, and operational systems
  • Utility customer lifecycle and service event processing
  • Large-scale event-driven integrations supporting a multi-year CIS transformation program

About the company

Founded in 2007, DTI (Diversified Technology, Inc.) is a successful African American owned IT Consulting/Staffing firm based in Chicago''s Loop.

Apply for this position