Senior Data Streaming Engineer - Data Platform
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+18 more
Job description
We are seeking a highly skilled Data Engineer with deep expertise in real-time data streaming, cloud data platforms (Google Cloud Platform), and Apache Beam. In this role, you will design, build, and optimize streaming data pipelines that enable scalable, reliable, and high-quality data flows. You’ll collaborate closely with data scientists, analysts, and software engineers to ensure data is efficiently stitched, transformed, and delivered to power analytics, AI, and business intelligence initiatives., * Design, implement, and maintain real-time streaming pipelines using Apache Beam and GCP services (e.g., Dataflow, Pub/Sub, BigQuery, Cloud Storage).
- Develop scalable ETL/ELT solutions for both streaming and batch processing.
- Implement data stitching strategies to integrate multiple data sources into unified, high-quality datasets.
- Ensure data quality, reliability, and observability across pipelines.
- Optimize data workflows for performance and cost-efficiency in cloud environments.
- Apply best practices in CI/CD, infrastructure-as-code, and monitoring for data pipelines.
- Contribute to data governance, security, and compliance efforts.
Requirements
- 4+ years of experience in Data Engineering with a focus on real-time/streaming pipelines.
- Strong expertise with Google Cloud Platform (GCP): Dataflow, Pub/Sub, BigQuery, Cloud Storage, Cloud Composer, etc.
- Proficiency in Apache Beam (or equivalent frameworks such as Spark Structured Streaming, Flink).
- Solid programming skills in Python.
- Experience with data modeling, schema design, and data stitching across multiple sources.
- Knowledge of cloud-native DevOps practices (Terraform, Cloud Deployment Manager, CI/CD pipelines).
- Strong problem-solving skills and ability to work in fast-paced environments.
- Hands-on knowledge of data observability tools (e.g., Datadog, Prometheus, OpenLineage).
- Strong understanding of event-driven architectures and message queues.
- Prior experience in high-volume, mission-critical data environments.
Benefits & conditions
- 30 days of paid vacation plus the option of up to 15 days of unpaid leave
- 25 days of workation within the EU
- Flexible working hours
- Sofa Concerts and employee events
- Discounts on ticket purchases & opportunities for clearing assignments
- Corporate benefits and discounts at KESS
- Central location & subsidy for a Job Ticket or Germany Ticket
- Bike leasing
- Mental health program & company pension scheme
- “GoFluent” language learning platform as well as Lunch & Learn sessions
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.adzuna.deGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary Germany
Data Engineer Salary UK
Where To Find Software Engineering Jobs
Top-Paying Tech Jobs (with Salaries)