Senior Data Engineer

N Consulting Ltd
Bath, United Kingdom
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 78K

Job location

Bath, United Kingdom

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Continuous Integration
ETL
Hive
Python
Release Management
Power BI
Amazon Web Services (AWS)
SQL Databases
Delivery Pipeline
AWS Lambda
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Cloudwatch
Data Pipelines

Requirements

The Senior Data Engineer must be an experience data professional with in-depth skills on AWS Cloud architecture, AWS data services, Data Pipeline automation (with AI integrations desirable) and ETL development (design, build, test and performance tune). Must have knowledge on data modelling techniques, including dimensional models and conformed datasets. As the role is to engage both business and technical stakeholders, the individual must have clear and adequate communication with different stakeholders at the various levels of seniority.

Knowledge and Experience - essential

  • AWS Glue ETL
  • AWS Glue Data Quality
  • AWS Lambda
  • AWS Lake Formation
  • Medallion Architecture based ETL processes using S3, Iceberg and Athena
  • Azure DevOps/AWS CodeCommit/AWS CodePipeline
  • AWS Step functions
  • Athena SQL ; Spark SQL ; Python
  • AWS CLI
  • Release management (CI/CD)

Knowledge and Experience - desirable

  • AWS Databrew
  • AWS RDS/Redshift
  • AWS Macie
  • AWS CloudWatch
  • AWS Quick
  • AWS Sagemaker (Unified Studio and AI)
  • Power BI

Apply for this position