Data Engineer

Blatchford Limited
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Tech stack

Agile Methodologies
Azure
Code Review
Databases
Continuous Integration
Data Governance
Data Integration
ETL
Database Queries
DevOps
Python
Microsoft SQL Server
Secure Coding
Service-Oriented Architecture
Software Engineering
Data Streaming
T-SQL
Microsoft Power Automate
System Availability
Delivery Pipeline
Backend
PySpark
Google Cloud Functions
Cosmos DB
Operational Systems
REST
Serverless Computing

Job description

As Data Engineer you will develop and construct data products and services and integrate them into systems and business processes., * Implementing data flows to connect operational systems, data for analytics and business intelligence (BI) systems.

  • Re-engineering manual data flows to enable scaling and repeatable use.
  • Supporting the build of data streaming systems.
  • Writing ETL / ELT scripts and code to make sure the process performs optimally.
  • Developing data models to support self-service business intelligence reporting that can be re-used to enforce data standards and quality.
  • Building accessible data for analysis.
  • Recognising opportunities to re-use existing data flows.
  • Leading the build of data streaming systems.
  • Leading work on database management.
  • Defining and implementing database architectures that meet business requirements for data availability.
  • Providing third line support of incidents and problems through systematic investigation and root cause analysis.
  • Carrying out code reviews and implement changes via DevOps pipelines.

Requirements

  • Relevant degree of industry recognised qualification.
  • Previous experience in a similar role.
  • Knowledge of Azure ETL services (Data Factory, Synapse etc).
  • Experience of using CI/CD, MS Azure and Azure Dev Ops in an agile environment.
  • Knowledge and understanding Strong proficiency in T-SQL and writing quality T-SQL scripts
  • Experience with various databases e.g. MS SQL, Azure Cosmos DB.
  • Skilled at optimizing large and more complicated SQL statements.
  • Proficiency in Python and experience with PySpark
  • Experience of REST API standards.
  • Proficiency in writing clean, readable, and secure code for Azure backend services, i.e. functions, utility functions etc.
  • Experience of Agile development methodologies
  • Good understanding of Service Oriented architecture and approaches to data integration and serverless application development e.g. Logic Apps, Function Apps.
  • Curious, eager to learn with a growth mindset
  • Strong collaborator.

This is a fantastic opportunity to work within a unique environment and contribute to the success of our award-winning organisation.

Benefits & conditions

  • Highly competitive salary
  • 25 days holiday (rising with service)
  • Option to purchase additional holiday.
  • Flexible, Hybrid working.
  • On Demand Pay
  • Pension
  • Death in Service
  • Discounted shopping and leisure activities
  • Health cash plan
  • Cycle to work scheme

Apply for this position