Data Engineer

Blue Orange Digital
Berlin, Germany
31 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
€ 86K

Job location

Remote
Berlin, Germany

Tech stack

Unit Testing
Azure
Code Review
Information Engineering
Data Warehousing
Document-Oriented Databases
Azure
SAP Applications
SQL Databases
Data Ingestion
Azure
Spark
Microsoft Fabric
Data Lake
PySpark
Information Technology
Data Lineage
SAP S/4HANA
Data Pipelines
Databricks

Job description

Blue Orange Digital is seeking a Mid-Level Data Engineer to join a 26-week enterprise data warehouse implementation for a global commodities trading and supply chain company, embedded full-time from Week 3 through Week 22.

You will build and maintain Bronze and Silver layer pipelines on Microsoft Fabric, implementing ingestion from multi-source ERP and CTRM systems and transformations that feed Gold-layer data products across trading, risk, and finance domains.

Working within a project-based delivery team alongside a Senior Data Engineer and Solutions Architect, you will contribute to a structured, phase-gated delivery with clear milestones and real production output., * Implement Bronze ingestion pipelines from source systems including CTRM instances (Irely) and ERP/SAP S/4HANA feeds using Microsoft Fabric Data Factory

  • Build Silver-layer transformation logic in Fabric notebooks using PySpark and SQL on Delta Lake tables, covering cleansing, standardization, and business rule application
  • Support development of Gold-layer outputs aligned to Trader P&L, Global Position, and Financial Consolidation data products
  • Write and maintain pipeline code on OneLake/Lakehouse following medallion architecture patterns (Bronze/Silver/Gold) established by the Technical Lead
  • Participate in code reviews and apply BOD and engagement-level coding standards consistently
  • Conduct unit and integration testing for pipeline outputs; document data flows and transformation logic
  • Coordinate with client-side Fabric/Azure engineers to align ingestion patterns and shared schemas
  • Support documentation of data lineage, transformation logic, and pipeline metadata throughout the engagement

Requirements

Do you have experience in Unit testing?, Do you have a Bachelor's degree?, * 5-6 years of data engineering experience with hands-on pipeline development across multi-source environments

  • Proficiency with Microsoft Fabric (OneLake, Lakehouse, Notebooks, Data Factory) or a comparable Azure data stack (ADF, ADLS Gen2, Databricks/Spark)
  • Solid SQL and PySpark skills with working knowledge of Delta Lake table formats
  • Experience building end-to-end pipelines for multi-source integration
  • Familiarity with Bronze/Silver/Gold medallion architecture patterns
  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent experience), * Exposure to ERP or CTRM source system data (SAP, Irely, or similar commodity/trading platforms)
  • Microsoft Azure data certification (DP-203 or equivalent)
  • Experience in commodity trading, logistics, or financial services data environments
  • Basic

Salary: $ 5,500 - 7,200 [ USD ] monthly

About the company

Blue Orange Digital is a boutique data & AI consultancy that delivers enterprise-grade results. We design and build modern data platforms, analytics, and ML/AI Agent solutions for mid-market and enterprise clients across Private Equity, Financial Services, Healthcare, and Retail. Our teams work with technologies like Databricks, Snowflake, dbt, and the broader Microsoft ecosystem to turn messy, real-world data into trustworthy, actionable insight. We're a builder-led, client-first culture that prizes ownership, clear communication, and shipping high-impact work. Note: Please submit your resume in English, as all application materials must be in English for review and consideration.

Apply for this position