Data Engineer
Role details
Job location
Tech stack
Job description
We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines using Microsoft Fabric and Databricks. You will work closely with our Product and Engineering teams to ensure data flow and integration across our data ecosystem. Your expertise will help us to improve our data infrastructure, improve data quality, and enable data-driven decision-making across the organization., * Design, build, and maintain large-scale data pipelines using Microsoft Fabric and Databricks
- Develop and implement data architectures that meet business requirements and ensure data quality, security, and compliance
- Collaborate with wider Product & Engineering teams to integrate data pipelines with machine learning models and analytics tools
- Optimise data processing and storage solutions for performance, scalability, and cost-effectiveness
- Develop and maintain data quality checks and monitoring tools to ensure data accuracy and integrity
- Work with cross-functional teams to identify and prioritize data engineering projects and initiatives
- Stay up-to-date with industry trends and emerging technologies in data engineering and cloud computing, All Employee Long Term Incentive Plan (LTIP) - Gives all EQ Colleagues the opportunity to benefit if the current owners successfully sell the company for a profit.
Health and Wellbeing - Employee Assistance Programme: counselling, legal & wellbeing support for colleagues and their households. Life assurance cover at 4x salary with the ability to purchase enhanced cover.
Employee discounts - Discounts and cashback at your favourite high street stores through our EQ Wins Platform.
Flexible Benefits - The ability to purchase a wide variety of benefits through our flex plan; gadgets, travel insurance, will writing, holiday trading and more.
Time Off - 28 days holiday + bank holidays. 2 volunteer days to get involved with a charity of your choosing.
Winning together - Equiniti ICON award vouchers; recognising the individuals going above and beyond to help the business succeed.
Learning & Development - Investment in LinkedIn Learning for all colleagues.
Requirements
- Good experience in data engineering, with a focus on cloud-based data pipelines and architectures
- Strong expertise in Microsoft Fabric and Databricks, including data pipeline development, data warehousing, and data lake management
- Proficiency in Python, SQL, Scala, or Java
- Experience with data processing frameworks such as Apache Spark, Apache Beam, or Azure Data Factory
- Strong understanding of data architecture principles, data modelling, and data governance
- Experience with cloud-based data platforms, including Azure and or AWS
- Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams
Desirable:
- Experience with Azure Synapse Analytics, Azure Data Lake Storage, or other Azure data services
- Experience with agile development methodologies and version control systems such as Git
- Certification in Microsoft Azure, Databricks, or other relevant technologies