Software Enginer - Kafka

AQUA IT
Herndon, United States of America
12 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Herndon, United States of America

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Business Analytics Applications
Computer Programming
Data as a Services
Information Engineering
ETL
Data Warehousing
Distributed Systems
Amazon DynamoDB
Performance Tuning
Amazon Web Services (AWS)
Software Engineering
Management of Software Versions
Servicebus
Data Lake
Kubernetes
Deployment Automation
Amazon Web Services (AWS)
Real Time Data
Kafka
Api Design
Api Gateway
Amazon Web Services (AWS)
Stream Processing
Data Pipelines
Redshift

Job description

  • Design, build, and maintain highly scalable Apache Kafka streaming systems to support near real-time data ingestion and processing across distributed environments
  • Define and develop comprehensive technical onboarding requirements for new data types, ensuring seamless integration and compatibility with existing streaming infrastructure
  • Develop and maintain robust metrics reporting for Kafka services, including end-to-end latency, throughput, and operational status to drive performance visibility and proactive issue resolution

Requirements

  • TS/SCI with CI Poly required

  • Must be willing to work in SCIF daily or as needed

  • 5+ years of professional software engineering experience with cloud-first development approach

  • 5+ years of hands-on experience with AWS CDK for Infrastructure as Code

  • 3+ years building complex, reusable CDK constructs and stacks

  • Proficiency in async programming and performance optimization* 3+ years implementing multi-environment deployment strategies using CDK

  • 5+ years of advanced Python development experience

  • API design and versioning (preferably with Apache Kafka)

  • 4+ years of data engineering experience

  • ETL/ELT pipeline development using AWS services

  • Experience with data lakes, data warehousing, and analytics platforms o Real-time data processing and streaming architectures

  • 3+ years with AWS cloud-native services o Advanced knowledge of Lambda, API Gateway, EventBridge, SQS, SNS o Experience with data services: RDS, DynamoDB, Redshift, S3, Athena o Container orchestration with ECS, Fargate, or EKS

  • Strong problem-solving abilities with proven track record of resolving complex technical challenges

Apply for this position