Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
Blue Orange Digital is seeking a Mid-Level Data Engineer to join a 26-week enterprise data warehouse implementation for a global commodities trading and supply chain company, embedded full-time from Week 3 through Week 22.
You will build and maintain Bronze and Silver layer pipelines on Microsoft Fabric, implementing ingestion from multi-source ERP and CTRM systems and transformations that feed Gold-layer data products across trading, risk, and finance domains.
Working within a project-based delivery team alongside a Senior Data Engineer and Solutions Architect, you will contribute to a structured, phase-gated delivery with clear milestones and real production output., * Implement Bronze ingestion pipelines from source systems including CTRM instances (Irely) and ERP/SAP S/4HANA feeds using Microsoft Fabric Data Factory
- Build Silver-layer transformation logic in Fabric notebooks using PySpark and SQL on Delta Lake tables, covering cleansing, standardization, and business rule application
- Support development of Gold-layer outputs aligned to Trader P&L, Global Position, and Financial Consolidation data products
- Write and maintain pipeline code on OneLake/Lakehouse following medallion architecture patterns (Bronze/Silver/Gold) established by the Technical Lead
- Participate in code reviews and apply BOD and engagement-level coding standards consistently
- Conduct unit and integration testing for pipeline outputs; document data flows and transformation logic
- Coordinate with client-side Fabric/Azure engineers to align ingestion patterns and shared schemas
- Support documentation of data lineage, transformation logic, and pipeline metadata throughout the engagement
Requirements
Do you have experience in Unit testing?, Do you have a Bachelor’s degree?, * 5-6 years of data engineering experience with hands-on pipeline development across multi-source environments
- Proficiency with Microsoft Fabric (OneLake, Lakehouse, Notebooks, Data Factory) or a comparable Azure data stack (ADF, ADLS Gen2, Databricks/Spark)
- Solid SQL and PySpark skills with working knowledge of Delta Lake table formats
- Experience building end-to-end pipelines for multi-source integration
- Familiarity with Bronze/Silver/Gold medallion architecture patterns
- Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent experience), * Exposure to ERP or CTRM source system data (SAP, Irely, or similar commodity/trading platforms)
- Microsoft Azure data certification (DP-203 or equivalent)
- Experience in commodity trading, logistics, or financial services data environments
- Basic
Salary: $ 5,500 - 7,200 [ USD ] monthly
About the company
Blue Orange Digital is a boutique data & AI consultancy that delivers enterprise-grade results. We design and build modern data platforms, analytics, and ML/AI Agent solutions for mid-market and enterprise clients across Private Equity, Financial Services, Healthcare, and Retail.
Our teams work with technologies like Databricks, Snowflake, dbt, and the broader Microsoft ecosystem to turn messy, real-world data into trustworthy, actionable insight.
We’re a builder-led, client-first culture that prizes ownership, clear communication, and shipping high-impact work.
Note: Please submit your resume in English, as all application materials must be in English for review and consideration.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary Germany
Top-Paying Tech Jobs (with Salaries)
The Most Popular IT Jobs on the Market
Backend Developer Salary in Germany [2023]