Data Engineer

Blue Orange Digital
Berlin, Germany
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
5 years minimum
Compensation
€66,000.0 - €86,400.0
Working hours
Regular working hours
Job source

Tech stack

Unit Testing Microsoft Azure Code Review Information Engineering Data Warehousing Document-Oriented Databases Azure Data Lake SAP (Applications) SQL Databases Data Ingestion Azure Data Factory Apache Spark
+8 more
Microsoft Fabric Data Lakes Pyspark Information Technology Data Lineage SAP S/4HANA Data Pipelines Databricks

Job description

Blue Orange Digital is seeking a Mid-Level Data Engineer to join a 26-week enterprise data warehouse implementation for a global commodities trading and supply chain company, embedded full-time from Week 3 through Week 22.

You will build and maintain Bronze and Silver layer pipelines on Microsoft Fabric, implementing ingestion from multi-source ERP and CTRM systems and transformations that feed Gold-layer data products across trading, risk, and finance domains.

Working within a project-based delivery team alongside a Senior Data Engineer and Solutions Architect, you will contribute to a structured, phase-gated delivery with clear milestones and real production output., * Implement Bronze ingestion pipelines from source systems including CTRM instances (Irely) and ERP/SAP S/4HANA feeds using Microsoft Fabric Data Factory

  • Build Silver-layer transformation logic in Fabric notebooks using PySpark and SQL on Delta Lake tables, covering cleansing, standardization, and business rule application
  • Support development of Gold-layer outputs aligned to Trader P&L, Global Position, and Financial Consolidation data products
  • Write and maintain pipeline code on OneLake/Lakehouse following medallion architecture patterns (Bronze/Silver/Gold) established by the Technical Lead
  • Participate in code reviews and apply BOD and engagement-level coding standards consistently
  • Conduct unit and integration testing for pipeline outputs; document data flows and transformation logic
  • Coordinate with client-side Fabric/Azure engineers to align ingestion patterns and shared schemas
  • Support documentation of data lineage, transformation logic, and pipeline metadata throughout the engagement

Requirements

Do you have experience in Unit testing?, Do you have a Bachelor’s degree?, * 5-6 years of data engineering experience with hands-on pipeline development across multi-source environments

  • Proficiency with Microsoft Fabric (OneLake, Lakehouse, Notebooks, Data Factory) or a comparable Azure data stack (ADF, ADLS Gen2, Databricks/Spark)
  • Solid SQL and PySpark skills with working knowledge of Delta Lake table formats
  • Experience building end-to-end pipelines for multi-source integration
  • Familiarity with Bronze/Silver/Gold medallion architecture patterns
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent experience), * Exposure to ERP or CTRM source system data (SAP, Irely, or similar commodity/trading platforms)
  • Microsoft Azure data certification (DP-203 or equivalent)
  • Experience in commodity trading, logistics, or financial services data environments
  • Basic

Salary: $ 5,500 - 7,200 [ USD ] monthly

About the company

Blue Orange Digital is a boutique data & AI consultancy that delivers enterprise-grade results. We design and build modern data platforms, analytics, and ML/AI Agent solutions for mid-market and enterprise clients across Private Equity, Financial Services, Healthcare, and Retail.

Our teams work with technologies like Databricks, Snowflake, dbt, and the broader Microsoft ecosystem to turn messy, real-world data into trustworthy, actionable insight.

We’re a builder-led, client-first culture that prizes ownership, clear communication, and shipping high-impact work.

Note: Please submit your resume in English, as all application materials must be in English for review and consideration.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · WWC 2024

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

6:24 min

Distributed data lakes and containerized computing clusters

Ulrich Wurstbauer +1 · LIVE

Videos

See all

Related articles

See all