Data Engineer
Randstad UK
Charing Cross, United Kingdom
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 85KJob location
Charing Cross, United Kingdom
Tech stack
Artificial Intelligence
JIRA
Software Documentation
Continuous Integration
Information Engineering
ETL
Data Security
Relational Databases
DevOps
Github
Python
Power BI
SQL Databases
Feature Engineering
Snowflake
Microsoft Fabric
PySpark
Data Pipelines
Job description
- Build & Integrate: Develop complex ETL/ELT pipelines and implement OneLake interoperability between Fabric and Snowflake.
- Architect: Operate a Medallion architecture (Bronze/Silver/Gold) and design curated datasets optimized for Power BI.
- Secure: Implement rigorous data security, GDPR compliance, and client ring-fencing (Row-Level Security).
- Innovate: Create SQL and PySpark notebooks to prepare feature engineering datasets for AI/ML models.
- Collaborate: Work independently via Jira/GitHub, maintaining high CI/CD and documentation standards.
Requirements
We are seeking a proactive Data Engineer (II) to build and scale high-performance data pipelines across Microsoft Fabric (OneLake) and Snowflake. This role is central to powering our BI, analytics, and AI/ML initiatives., * 5+ years of Data Engineering experience.
- Expertise: Deep knowledge of Snowflake and Microsoft Fabric.
- Tech Stack: Advanced SQL, Python, and PySpark (Notebooks).
- Modelling: Strong relational data modelling and cloud cost optimization skills.
- DevOps: Experience with GitHub, CI/CD, and workflow orchestration.
