Software Engineer ? Data Streaming Platforms

Eccalon, LLC
Detroit, MI, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Adobe InDesign Application Programming Interfaces (APIs) Amazon Web Services Microsoft Azure Bash Shell Big Data C++ (Programming Language) Network Analysis Program Optimization Code Review Codecs Data Compression
+38 more
Computer Programming Computer Networks Computer Engineering Network Congestion Data Infrastructure Data Loss Serialization Data Systems Software Debugging Multiplexing Distributed Systems Memory Management Fault Tolerance FFmpeg Protocol Buffers H.264/MPEG-4 AVC JSON Python (Programming Language) Machine Learning Network Protocols Open Source Technology Performance Tuning Socket Programming Software Engineering Data Streaming System Programming Data Logging Multithreading Real Time Systems High Efficiency Video Coding (HEVC) Delivery Pipeline Concurrency Audio Codec Event Driven Architecture Information Technology Low Latency Api Design Stream Processing

Job description

We are seeking a Software Engineer with a strong focus on data streaming and real-time processing platforms to help design, build, and operate scalable, high-throughput, low-latency systems. This role will work on distributed systems that ingest, process, and deliver streaming data used for analytics, machine learning, monitoring, and mission-critical applications. You will collaborate closely with data engineers, platform engineers, product teams, and infrastructure to ensure reliability, performance, and scalability across streaming pipelines., * Design, build, and maintain scalable data streaming pipelines

  • Develop and operate event-driven architectures using streaming technologies
  • Implement real-time and near-real-time data processing applications
  • Ensure data correctness, ordering, fault tolerance, and exactly-once or at-least-once semantics as required
  • Contribute to the design and evolution of streaming platforms and internal data infrastructure
  • Build resilient, high-availability services capable of handling large volumes of data
  • Optimize systems for throughput, latency, and resource efficiency
  • Participate in capacity planning and performance tuning
  • Implement monitoring, logging, alerting, and metrics for streaming applications
  • Debug production issues related to performance, lag, data loss, or backpressure
  • Support on-call rotations and incident response for critical data systems
  • Improve automation, deployment pipelines, and operational tooling
  • Collaborate with product, analytics, and ML teams to support data use cases
  • Write clean, maintainable, and well-tested code
  • Participate in design reviews, code reviews, and technical discussions
  • Contribute to documentation and engineering best practices

Requirements

Do you have experience in Video compression?, Do you have a Bachelor’s degree?, * Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field (or equivalent practical experience).

  • 3+ years of professional software engineering experience.
  • Systems Programming: 2+ years of hands-on experience programming real-time applications at the Low-Level / Packet Level using C, C++, or Rust.
  • Must be highly comfortable with manual memory management, pointer manipulation, and multi-threaded optimizations.
  • Strong experience in a modern concurrency language like Go or Python for stream orchestration, tooling, and control-plane API development.
  • Network Protocols: Deep, foundational understanding of UDP and TCP/IP networking mechanics. Direct experience managing socket programming, custom congestion control, packet pacing, and error correction techniques (ARQ / selective retransmission).
  • Media Transport: Proven experience with broadcast and linear video workflows, including media containers and multiplexing (specifically MPEG-TS wrappers).
  • Experience building custom stream troubleshooting, diagnostic, or real-time monitoring software.
  • Codecs: Codec-agnostic architecture mindset with low-level implementation knowledge of H.264/AVC, H.265/HEVC, and emerging standards like AV1.
  • Automation & Scripting: Strong scripting capabilities in Python or Bash for stream orchestration, pipeline automation, and local-first systems management., * Direct development experience with libsrt, librist, RTMP, or similar APIs.
  • Deep familiarity with open-source media frameworks like FFmpeg, Astreamer, GStreamer, and low level packet streaming tools.
  • Experience using network analysis to debug packet loss, jitter, clock drift, and MTU issues on live networks.
  • Familiarity with AWS, GCP, or Azure specifically regarding networking components (firewall traversal, listener/caller architecture, and high-bandwidth ingress).
  • Lightweight containerization experience or portable streaming endpoints or edge-compute tools.
  • Knowledge of serialization formats (like Protobuf or JSON) strictly for control-plane APIs and performance telemetry aggregation.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 · Coffee With Developers

1:09 min

Integrating speech models using the Twilio real-time SDK

Marius Obert Marius Obert · Coffee With Developers

2:17 min

Automating multi-angle video cuts using PHP and FFmpeg

Chris Heilmann Chris Heilmann +2 · LIVE

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

1:37 min

Optimizing latency and cost with free open source software

Rahima Yakoob · WWC 2023

6:16 min

Scaling topic partitions and configurations to maximize throughput

Kirill Kulikov · LIVE

Videos

See all

Related articles

See all