Data Engineer
B3Living
Broxbourne, United Kingdom
5 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 61KJob location
Broxbourne, United Kingdom
Tech stack
Information Engineering
Data Governance
ETL
Document-Oriented Databases
Python
Performance Tuning
Query Optimization
SQL Databases
Data Logging
Spark
Microsoft Fabric
Star Schema
Data Pipelines
Job description
- Design and maintain scalable data pipelines and robust data models.
- Ensure data accuracy, accessibility, and security.
- Improve troubleshooting by introducing error handling and logging.
- Optimise efficiency by monitoring data performance and applying fine-tuning techniques.
- Write complex queries in SQL, Python, and Spark.
- Document data structures.
- Collaborate with colleagues to address business needs while maintaining governance standards and GDPR compliance.
Technologies:
- ETL
- Fabric
- Support
- Python
- SQL
- Security
- Spark
Requirements
- Proven experience in data engineering or data platform development.
- Experience with testing frameworks and writing test plans for data pipelines.
- Strong analytical and problem-solving skills.
- Strong SQL skills and experience with query optimisation.
- Knowledge of Microsoft Fabric (Lakehouse, Dataflows, ADF).
- An understanding of data modelling concepts (e.g. dimensional, star schema, denormalisation).
- Knowledge of performance tuning techniques for ETL and SQL processes.
- Familiarity with data governance principles and GDPR.
