Remote Kafka Engineer (GTW)

Insight Global
East Hartford, United States of America
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

East Hartford, United States of America

Tech stack

Azure
Cloud Computing
Data Warehousing
Parsing
Performance Tuning
Role-Based Access Control
Standard Sql
SQL Databases
Data Streaming
Systems Integration
Apache Zookeeper
Kafka
Data Management
Data Pipelines

Job description

An aerospace manufacturing employer is seeking an experienced Kafka Engineer to assess their existing Apache Kafka footprint (hosted on Zeta Cloud) and help improve stability, performance, and scalability as they expand Kafka to additional sites. The current team does not have any in-house Kafka expertise which is why this role is so critical. This person will evaluate broker, ZooKeeper/Kraft, and client configurations; diagnose and remediate performance and server issues; and implement best practices for security, resiliency, observability, and capacity planning. A key focus will be integrating KINEXON location-tracking streams-ingesting real-time XY coordinate data, transforming it, and delivering it through SQL pipelines into our enterprise data warehouse. Success in this role includes producing an actionable remediation roadmap, standing up or tuning multi-site deployments (topics, partitions, replication, RBAC), and delivering thorough documentation and as well as

Requirements

knowledge transfer so our internal team can get up to speed with Kafka as well. Ideal candidates have deep Kafka operations and streaming design expertise, experience with KINEXON data flows, strong SQL/data warehousing skills, and a coaching mindset. This resource should be open to exploring new technologies and toolsets especially Azure Event Grid, as there is a possibility of a cutover to this tool and this team would also support that., Deep hands-on expertise with Apache Kafka operations (broker tuning, partitioning, replication, monitoring, multi-site deployment, and troubleshooting performance/server issues).

Experience with KINEXON or similar IoT/location-tracking data platforms, including parsing real-time XY coordinate streams and handling high-volume sensor data.

Strong SQL and data pipeline engineering skills, including transforming streaming data and delivering it into a data warehouse environment.

Cloud deployment experience (Zeta Cloud preferred) with the ability to assess an existing environment, identify gaps, and implement best-practice architecture.

Excellent documentation and knowledge-transfer capability, with the ability to upskill an internal team and deliver clear runbooks, configs, and support guidelines.

Apply for this position