Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity to work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities.
The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics and business-critical decision-making. You will collaborate with a range of stakeholders to ensure data is accessible, reliable and delivered efficiently across the organisation., * Design, build and maintain scalable and reliable data pipelines.
- Develop and support ETL/ELT processes for ingesting and transforming data from multiple sources.
- Enhance and maintain cloud-based data infrastructure within AWS.
- Monitor, troubleshoot and optimise data workflows to ensure high performance and reliability.
- Implement best practices around data quality, governance and monitoring.
- Support the development of a centralised data platform and data architecture.
- Work closely with analysts, engineers and business stakeholders to understand data requirements and deliver solutions.
- Participate in code reviews and contribute to engineering standards and best practices.
- Identify opportunities to improve existing processes through automation and optimisation.
- Ensure data solutions are secure, scalable and aligned with business objectives.
Requirements
- 3-6 years' experience in Data Engineering or a related discipline.
- Strong programming experience with Python.
- Advanced SQL skills and experience working with large datasets.
- Hands-on experience with AWS services and cloud-based data platforms.
- Experience building and maintaining production-grade data pipelines.
- Experience using Airflow for workflow orchestration.
- Strong version control experience using Git.
- Understanding of data modelling principles and database design.
- Excellent problem-solving and analytical skills.
- Strong communication skills with the ability to engage technical and non-technical stakeholders.
Desirable
- Experience working with data lakes or modern data warehouse technologies.
- Exposure to Infrastructure as Code tools.
- Experience with CI/CD practices and automated deployment pipelines.
- Knowledge of data governance, monitoring and observability tools.
- Experience working within fast-paced, data-driven environments., * MS Azure Databricks
Benefits & conditions
- Salary up to £80,000.
- Opportunity to work with modern cloud and data technologies.
- Exposure to complex, high-impact data engineering challenges.
- Collaborative and highly skilled technical environment.
- Career development and progression opportunities.
- Hybrid working environment.
- Competitive benefits package.
If you are passionate about building reliable data platforms, solving complex engineering problems and delivering scalable data solutions, we would be interested in speaking with you.