> Markdown version of [/jobs/ext/2559229-senior-data-engineer-streaming](https://www.wearedevelopers.com/jobs/ext/2559229-senior-data-engineer-streaming). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer - Streaming

- **Company:** The Coca-Cola Company
- **Location:** Atlanta, GA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Adobe Analytics, Data Infrastructure, Data Streaming, Azure Service Bus, Microsoft Fabric, Data Lakes, Pyspark, Apache Flink, Real Time Data, Apache Kafka, Spark Streaming
- **Published:** August 6, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-data-engineer-streaming-atlanta-ga-usa-58855281

## About the Role

and streaming concepts (stateful processing, watermarking, late-arriving data remediation, complex windowing) into reusable templates * Codify end-to-end idempotency with deterministic replay and effective-once delivery * Create metadata-driven frameworks that tolerate upstream schema drift without disrupting downstream streaming queries * Serve as internal authority on streaming design across Kafka/Event Hubs for scalable Fabric ingestion * Develop standardized dashboards to monitor end-to-end data lag, throughput, backpressure, and DLQ routing Tasks * 8+ years in data platform architecture * 3+ years architecting/operating production-grade Streaming and Kappa architectures * 4+ years Spark Streaming and Apache Kafka pipelines (topic partitioning, consumer groups, schema registries, high-throughput tuning) * Deep familiarity with Spark Structured Streaming, Kafka Streams, or Apache Flink * Strong Scala and/or PySpark experience with stateful Structured Streaming * Advanced knowledge of aa
and Lake append-only sinks and checkpointing * Framework mindset with developer-facing frameworks or configurable streaming engines * Ability to articulate complex streaming concepts to developers and executives Key requirements * medical benefits * financial benefits * annual incentive/support * growth culture * inclusive and agile environment * remote/hybrid options (implied by large company practices)

## Description

Experteer Overview In this role you will design and codify enterprise streaming patterns to shift Coca-Cola's data estate toward a continuous, event-driven model. You'll build reusable frameworks and templates that enable teams to deploy real-time data streams on Microsoft Fabric, with a focus on Kappa patterns and end-to-end reliability. You will act as the internal authority on streaming design, driving scalable ingestion and robust backfill, with dashboards to monitor health metrics. This is a high-impact opportunity to shape how real-time data supports business SLAs and decision-making. Compensation / Benefits * Build a reusable streaming architecture playbook emphasizing Kappa patterns and near-real-time analytics on Fabric * Architect, document, and templatize replay/backfill mechanisms (offset reset, checkpoint/state management, dedupe strategies) * Develop architectural blueprints and guardrails for sub-second/near-real-time latency aligned with business SLAs * Package advanced streaming concepts (stateful processing, watermarking, late-arriving data remediation, complex windowing) into reusable templates * Codify end-to-end idempotency with deterministic replay and effective-once delivery * Create metadata-driven frameworks that tolerate upstream schema drift without disrupting downstream streaming queries * Serve as internal authority on streaming design across Kafka/Event Hubs for scalable Fabric ingestion * Develop standardized dashboards to monitor end-to-end data lag, throughput, backpressure, and DLQ routing Tasks * 8+ years in data platform architecture * 3+ years architecting/operating production-grade Streaming and Kappa architectures * 4+ years Spark Streaming and Apache Kafka pipelines (topic partitioning, consumer groups, schema registries, high-throughput tuning) * Deep familiarity with Spark Structured Streaming, Kafka Streams, or Apache Flink * Strong Scala and/or PySpark experience with stateful Structured Streaming * Advanced knowledge of Delta Lake append-only sinks and checkpointing * Framework mindset with developer-facing frameworks or configurable streaming engines * Ability to articulate complex streaming concepts to developers and executives Key requirements * medical benefits * financial benefits * annual incentive/support * growth culture * inclusive and agile environment * remote/hybrid options (implied by large company practices)


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [What If We've Been Scaling Stream Processing Wrong All Along?](https://www.wearedevelopers.com/videos/100139-what-if-we-ve-been-scaling-stream-processing-wrong-all-along)
- [Python-Based Data Streaming Pipelines Within Minutes](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes)
- [Building the platform for providing ML predictions based on real-time player activity](https://www.wearedevelopers.com/videos/944-building-the-platform-for-providing-ml-predictions-based-on-real-time-player-activity)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)