Data Engineer
Role details
Job location
Tech stack
Job description
Blue Orange Digital is seeking a Mid-Level Data Engineer to join a 26-week enterprise data warehouse implementation for a global commodities trading and supply chain company, embedded full-time from Week 3 through Week 22.
You will build and maintain Bronze and Silver layer pipelines on Microsoft Fabric, implementing ingestion from multi-source ERP and CTRM systems and transformations that feed Gold-layer data products across trading, risk, and finance domains.
Working within a project-based delivery team alongside a Senior Data Engineer and Solutions Architect, you will contribute to a structured, phase-gated delivery with clear milestones and real production output., * Implement Bronze ingestion pipelines from source systems including CTRM instances (Irely) and ERP/SAP S/4HANA feeds using Microsoft Fabric Data Factory
- Build Silver-layer transformation logic in Fabric notebooks using PySpark and SQL on Delta Lake tables, covering cleansing, standardization, and business rule application
- Support development of Gold-layer outputs aligned to Trader P&L, Global Position, and Financial Consolidation data products
- Write and maintain pipeline code on OneLake/Lakehouse following medallion architecture patterns (Bronze/Silver/Gold) established by the Technical Lead
- Participate in code reviews and apply BOD and engagement-level coding standards consistently
- Conduct unit and integration testing for pipeline outputs; document data flows and transformation logic
- Coordinate with client-side Fabric/Azure engineers to align ingestion patterns and shared schemas
- Support documentation of data lineage, transformation logic, and pipeline metadata throughout the engagement
Requirements
Do you have experience in Unit testing?, Do you have a Bachelor's degree?, * 5-6 years of data engineering experience with hands-on pipeline development across multi-source environments
- Proficiency with Microsoft Fabric (OneLake, Lakehouse, Notebooks, Data Factory) or a comparable Azure data stack (ADF, ADLS Gen2, Databricks/Spark)
- Solid SQL and PySpark skills with working knowledge of Delta Lake table formats
- Experience building end-to-end pipelines for multi-source integration
- Familiarity with Bronze/Silver/Gold medallion architecture patterns
- Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent experience), * Exposure to ERP or CTRM source system data (SAP, Irely, or similar commodity/trading platforms)
- Microsoft Azure data certification (DP-203 or equivalent)
- Experience in commodity trading, logistics, or financial services data environments
- Basic
Salary: $ 5,500 - 7,200 [ USD ] monthly