Data Engineer
Role details
Job location
Tech stack
Job description
We're looking for a talented Data Engineer to help shape the future of our data platform. If you're passionate about cloud technologies, agile delivery and creating real value through data, this could be the perfect role for you!, * We are deeply committed to advancing our Data Strategy, embarking on a transformative journey from traditional on-premises infrastructure to a cloud-based architecture. Our cloud-native Data Platform utilises Microsoft Azure technology including Azure Databricks, Azure Data Factory and dbt.
- We seek an individual with a proven track record in Azure cloud Data Engineering to join our team, contributing their expertise to shape and execute the design and implementation of our cloud-native platform.
- Collaborating closely with other Data Engineers and Analysts, as well as colleagues from across the organisation to deliver trusted solutions that meet the Society's information needs. You'll play a key role in the Society change hubs and play a pro-active role in identifying process improvements and generating new ideas that will maximise the value of data for the Society.
- We embrace a culture of experimentation and constantly strive for improvement and learning. Using Agile techniques, you will regularly deliver incremental enhancements to our products. You will actively participate in design and code reviews, providing direction and mentoring to others.
- You will do this working in a collaborative, trusting, environment, one that encourages diversity of thought and creative solutions that are in the best interests of our customers and colleagues.
- As the UK tech industry booms, this diverse sector is alive with career potential.
Requirements
Do you have experience in Spark?, * Experience in the development of Azure Data solutions
- Knowledge of data modelling principles, including common patterns, e.g. star schema, snowflake or data vault
- Experience in implementation end-to-end ETL/ELT solutions
- Experience in m aintaining and optimising an Enterprise Data Warehouse
- Knowledge of data analysis
- Knowledge of testing and software release management
- Experience in business process and requirements analysis
- Experience of full life-cycle software development
- Understanding of Agile methodologies
- Experience working with CI/CD tools
Key Technology:
- Azure Databricks, Data Factory, Storage, Key Vault
- Experience with source control systems, such as Git
- dbt (Data Build Tool) for transforming and modelling data
- SQL (Spark SQL) & Python (PySpark)
Certifications:
- Microsoft Certified: Azure Fundamentals (AZ-900)
- Microsoft Certified: Azure Data Fundamentals (DP-900)
You will need to be you.
- Curious about technology and adaptable to new technologies
- Agile-minded, optimistic, passionate, and pragmatic about delivering valuable data solutions to customers
- Willing to mentor & support colleagues, leveraging their experience & knowledge
Benefits & conditions
Pulled from the full job description
-
Annual leave
-
Company pension
-
Paid volunteer time
-
Private medical insurance
-
Cycle to work scheme
-
Discounted gym membership
-
Car scheme, Skipton values work/life balance and we are proud to support hybrid and flexible working, where possible. We have a newly refurbished head office which offers a vibrant and collaborative working space.
-
We have a range of other benefits available to you including;
-
Annual discretionary bonus scheme
-
25 days standard annual leave + bank holidays + rising 1 day per year of service to a maximum of 30 days
-
Holiday trading scheme allowing the ability to buy and sell additional annual leave days
-
Matching employer pension contribution (up to 10% per annum)
-
Colleague mortgage (conditions apply)
-
Salary sacrifice scheme for hybrid & electric car
-
A commitment to training and development
-
Private medical insurance for all our colleagues
-
3 paid volunteering days per annum
-
Diverse and inclusive colleague networks available for you to join
-
We care about your health and wellbeing - we provide a range of benefits that support this including cycle to work initiative and discounted gym membership