Data Engineer

Sanderson Recruitment Plc
Edinburgh, UK
5 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Agile Methodology Microsoft Azure Big Data Content Delivery Networks Continuous Integration Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Relational Databases Scrum Methodology Standard Sql
+9 more
SQL Databases SQL Server Integration Services Git Collibra Maintaining Code Data Management Data Delivery Software Coding Software Version Control

Job description

As a Data Engineer you will be responsible for designing, developing and delivering solutions to load, optimise and transform data within our environment and the relevant infrastructure to support them.

The Data Engineer will provision, configure and implement Azure infrastructure consisting of SQL instances and other Fabric components as required to support the data needs of Diligenta.

You will be a key part of designing and building out our data infrastructure that will help to drive data insights, data use and value across the business., * Help build, implement and contribute to best practices within the engineering environment such as naming conventions, coding standards and design briefs

  • Work to promote, implement and maintain clear code and documentation for all projects
  • Maintain wiki entries for engineering, development and product environments
  • Use CI/CD frameworks to iterate through and optimise solutions
  • Use source control solutions to maintain our code base (GIT), maintaining code branches and release versions
  • Work to deliver products and solutions utilising agile methodologies
  • Help build and operate a content delivery network for solution delivery and maintenance
  • Create solutions that comply with data governance frameworks and data management processes and policies
  • Be an active part of product and change refinement processes to help define stories, features and contribute development estimates
  • Be a key part of designing and building out our Fabric infrastructure that will help to drive data insights, data use and value across the business

Requirements

  • Prior experience in a similar Data Engineering role in either a software or data delivery environment
  • Educated up to a degree level or equivalent experience
  • Understanding of data governance concepts
  • Strong analytical skills
  • Familiarity with data privacy regulations such as GDPR
  • Proven experience designing and implementing ETL/ELT solutions
  • Knowledge of relational and non-relational data management systems
  • Experience with big data platforms, tools and environments
  • Experience with CI/CD tools and processes
  • Proficiency in SQL and SSIS
  • Experience working in an Agile delivery environment
  • Experience with MS Fabric environment
  • Experience with RDBMS platforms
  • SQL coding skills
  • Scrum or Kanban experience (desirable)
  • Experience with Purview, Collibra, Erwin or similar (desirable)

Benefits & conditions

  • 33 days including bank holidays
  • Eligibility for an annual discretionary bonus scheme
  • Personal and career development opportunities to progress your aspirations within the company and our global parent company (Tata Consultancy Services)
  • Access to Perks at Work (an online discounted shopping platform) saving money on a wide range of goods and services
  • Cycle to Work Scheme and interest-free season ticket loans
  • A company-wide wellbeing programme, including an Employee Assistance Programme and other benefits/resources to support your mental, physical and financial wellbeing
  • A comprehensive set of Moments That Matter policies, such as Carer’s Leave, Foster Leave and Retirement Leave
  • A contributory company pension scheme with matching contributions up to 6%, group life assurance (Death in Service) and group income protection

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all