Data Engineer
Role details
Job location
Tech stack
Job description
- Develop and maintain scalable data pipelines and systems to manage large datasets effectively
- Collaborate with cross-functional teams to understand data requirements and implement solutions
- Ensure data quality, integrity, and availability across various systems and platforms
- Optimise data workflows and processes for efficiency and reliability
- Integrate data from multiple sources to support analytics and reporting needs
- Provide technical expertise in data engineering best practices and tools
- Monitor and troubleshoot data systems to resolve any issues promptly
- Document processes and maintain up-to-date records of data architecture and workflows
Technologies:
- C#
- Cloud
- ETL
- Support
- Python
- Spark
- Azure
Requirements
- A strong background in data engineering or a related field
- Proficiency in designing and implementing data pipelines and architectures
- Experience with Python, Spark, C#, or relevant programming skills
- Experience with cloud platforms and data processing tools
- Knowledge of database systems, ETL processes, and data modelling techniques
- Excellent problem-solving skills and a detail-oriented approach
- The ability to work collaboratively with diverse teams and stakeholders
Benefits & conditions
We are a medium-sized organization within the public sector, dedicated to delivering high-quality services. Our Analytics department is focused on driving impactful decision-making through a structured approach. This role as a Data Engineer offers a competitive salary ranging from £55,000 to £63,000 per annum, 25 days of annual leave plus bank holidays and flex days, and a very hybrid working model with flexible working patterns. We promote a great work-life balance with a 35-hour working week for full-time employees and competitive parental leave policies, alongside a pension scheme with a high employer contribution.