Streaming Data Architect

SHERPA LLC
Springfield, VA, United States
about 1 month ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$140,000.0 - $155,000.0
Working hours
Regular working hours

Tech stack

Amazon Web Services Architectural Patterns Microsoft Azure Cloud Database Cloud Engineering Communications Protocols Information Engineering Data Governance Distributed Systems Fault Tolerance Enterprise Messaging Systems Service Development Studio
+7 more
Data Streaming Cloud Platform System Event Driven Architecture Apache Kafka Data Management Multiaccess Edge Computing Microservices

Job description

  • Architect, design, and implement high performance streaming data platforms using NATS for IoT sensor data ingestion, processing, and distribution.
  • Define and maintain message schemas, subject taxonomies, and overall data governance patterns for real-time event-driven systems.
  • Develop scalable distributed streaming pipelines capable of handling high-throughput, low-latency, and bursty sensor data.
  • Collaborate closely with engineering teams to define data models, communication protocols, and ingestion strategies across diverse IoT devices.
  • Evaluate, select, and implement best-in-class frameworks, tooling, and architectural patterns for streaming analytics and durable messaging.
  • Optimize streaming architecture for reliability, fault-tolerance, and operations in heterogeneous or constrained environments.
  • Integrate streaming components seamlessly with cloud systems, microservices, and downstream analytics or storage platforms.

Requirements

We are seeking a highly experienced Streaming Data Architect to design and build real time streaming infrastructure for IoT environments using NATS. The ideal candidate has deep experience with modern streaming architectures and hands-on expertise with high volume messaging tools such as Kafka, NATS, or similar distributed systems., * 8-10 years of experience in data engineering, distributed systems, or related fields with significant focus on real-time or streaming architectures.

  • Hands-on experience with enterprise-scale streaming/messaging technologies (Kafka, NATS, Pulsar, or equivalent).
  • Proven experience designing, building, and operating distributed streaming platforms for IoT or telemetry-driven workloads.
  • Strong background in defining message schemas, subject hierarchies/taxonomies, and structured approaches to event data organization.
  • Deep understanding of streaming data patterns, event-driven architecture, and high-volume messaging systems.
  • Solid grounding in cloud-native architectures (AWS, Azure, or GCP).

Preferred / Nice-to-Have Skills

  • Direct experience building production systems with NATS (JetStream, NATS Server, client libraries, subject design).
  • Experience with IoT sensor data, telemetry systems, or device communication protocols.
  • Experience with UDP-based communications (e.g., QUIC), especially in latency-sensitive environments.
  • Experience in tactical or DDIL (Denied, Disrupted, Intermittent, Limited) operational environments.
  • Proficiency with Go for back-end or streaming service development.
  • Familiarity with edge computing patterns and bridging device-to-cloud data flows.

Soft Skills

  • Strong communication and collaboration skills.
  • Ability to explain complex distributed system concepts clearly and guide teams on architectural best practices.
  • A focus on performance, reliability, and continuous improvement., The proposed salary range is reflective across all Sherpa 6 locations, years of experience, and skill levels. Salary negotiations will be based on a host of factors including but not limited to your geographic location, prior experience, relevant skills, education, and certifications.

Benefits & conditions

We offer a competitive benefits package, covering the cost of medical for you and your family; we also offer dental, vision, health and wellness benefits and a generous retirement savings plan. We believe that our employees can manage their workload and their personal life, therefore we extend a generous PTO policy. This allows our employees to balance their lives as they see fit., $140,000-$155,000

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:37 min

Introduction to Apache Kafka benchmarking and performance analysis

Kirill Kulikov · LIVE

3:07 min

Transitioning architecture to microservices at Netflix

Steve Upton Steve Upton · World Congress 2022

1:47 min

Introduction to ClickHouse cloud database architecture

Jan Mensch Jan Mensch · World Congress 2026 Europe

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

1:39 min

Defining Apache Kafka and its primary real-time use cases

Lucia Cerchie · LIVE

4:30 min

Introducing data management and the shift to streaming

Mary Grygleski Mary Grygleski · LIVE

Videos

See all

Related articles

See all