> Markdown version of [/jobs/ext/777821-lead-data-engineer-partner-company-role](https://www.wearedevelopers.com/jobs/ext/777821-lead-data-engineer-partner-company-role). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer (Partner Company Role) - **Company:** FYST - **Location:** Germany (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Cloud Database, Information Engineering, Python (Programming Language), PostgreSQL, RabbitMQ, Snowflake, Debezium, Kubernetes, Apache Kafka, Data Delivery - **Published:** June 30, 2026 - **Apply:** https://de.indeed.com/viewjob?jk=5a08a8bd8f6fb6e5 ## About the Role Do you have experience in gRPC?, * 5+ years in data engineering with end-to-end ownership of production pipelines. * Hands-on with Snowflake, PostgreSQL CDC (Debezium preferred), and Kafka. * Solid AWS experience - S3, RDS, Aurora, and cloud data infrastructure. * Data quality engineering mindset: monitoring, reconciliation, lineage. * Comfortable defining data contracts and driving requirements with backend engineering teams. * Technical leadership experience: project ownership, cross-team alignment, delivery under constraints. * Kubernetes, Airflow/Prefect/Dagster, and dbt are strong pluses. * Payments domain knowledge - settlement, transaction lifecycle, processor integrations - is a strong plus. * Familiarity with gRPC, RabbitMQ, and reading Go/Python service code is expected. * English language skills at the B2 level and fluent russian language. ## Description * Implement CDC-based ingestion from PostgreSQL services (RDS, Aurora, EC2, K8s operator) using Debezium or equivalent. * Build streaming and near-real-time pipelines with defined SLAs. * Build a data quality control layer: checksums, reconciliation, schema validation, anomaly detection, and alerting. * Define quality checkpoints across the full pipeline - from source capture through Snowflake to client delivery. * Define and enforce data contracts with service-owning teams for core entities: transaction, merchant, settlement, and processing status. * Build the external data delivery layer: financial settlement, transaction status, processor reconciliation, and client analytics. * Design tenant separation and implement replay/reload mechanisms for failure recovery. * Start hands-on, then gradually hire and grow a small data engineering team as the function matures. Build a pragmatic roadmap with concrete deliverables at 3, 6, and 12 months. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Python-Based Data Streaming Pipelines Within Minutes](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes) - [Beyond Kafka & RabbitMQ: Why NATS is the Future of Microservices Messaging](https://www.wearedevelopers.com/videos/1646-beyond-kafka-rabbitmq-why-nats-is-the-future-of-microservices-messaging) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Swapping a Data Warehouse at Runtime: Zero-Downtime Migration Without Changing a Single Client](https://www.wearedevelopers.com/videos/100311-swapping-a-data-warehouse-at-runtime-zero-downtime-migration-without-changing-a-single-client) - [Why Systems Break After Initial Success: The Architectural Failures That Take Months to Surface](https://www.wearedevelopers.com/videos/2048-why-systems-break-after-initial-success-the-architectural-failures-that-take-months-to-surface) ## Related Articles - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary Germany](https://www.wearedevelopers.com/magazine/277-data-analyst-salary-germany) - [Backend Developer Salary in Germany [2023]](https://www.wearedevelopers.com/magazine/196-backend-developer-salary-in-germany-2023)