Data Lakehouse Engineer

N Consulting Ltd
Basildon, UK
6 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon S3 Apache HTTP Server Data Governance DevOps Identity and Access Management Python (Programming Language) Workflow Management Systems Data Storage Management HybridCloud Pyspark AWS Data Analytics
+2 more
Data Lakehouse Terraform

Job description

Data Lakehouse Engineer at N Consulting LtdJob Title: Data Lakehouse Engineer Work Type: Hybrid | Contract Locations: Basildon(UK) or Nenagh / Dublin (Ireland) or Warsaw (Poland)Role OverviewWe are seeking a highly skilled Data Lakehouse Engineer to join our team on a hybrid contract basis. This role focuses on designing, building, and optimizing modern data lakehouse architectures using AWS-native services and open table formats like Apache Iceberg. You will play a key role in enabling scalable, secure, and high-performance data platforms.Key Responsibilities Design and implement scalable AWS Data Lakehouse solutions Develop and maintain data pipelines using Python and PySpark Work with AWS services including: S3, EMR, Lambda, IAM, EKS, MWAA Build and manage Apache Iceberg tables for efficient data storage and querying Implement CI/CD pipelines for data platform deployments Use Terraform for infrastructure as code (IaC) Ensure data quality, governance, and security best practices

Orchestrate workflows and automate data processes Collaborate with cross-functional teams including data analysts, scientists, and DevOps engineersRequired Skills & Experience Strong experience in AWS Data Engineering Hands-on expertise with: AWS services: IAM, Lambda, EKS, S3, EMR, MWAA Apache Iceberg Python & PySpark Solid understanding of data lakehouse architecture principles Experience with CI/CD pipelines and Terraform Knowledge of data quality frameworks and data security standards Familiarity with workflow orchestration toolsPreferred Qualifications Experience working in hybrid cloud or multi-region environments Strong problem-solving and communication skills Ability to work independently in a contract setting

Requirements

Orchestrate workflows and automate data processes Collaborate with cross-functional teams including data analysts, scientists, and DevOps engineersRequired Skills & Experience Strong experience in AWS Data Engineering Hands-on expertise with: AWS services: IAM, Lambda, EKS, S3, EMR, MWAA Apache Iceberg Python & PySpark Solid understanding of data lakehouse architecture principles Experience with CI/CD pipelines and Terraform Knowledge of data quality frameworks and data security standards Familiarity with workflow orchestration toolsPreferred Qualifications Experience working in hybrid cloud or multi-region environments Strong problem-solving and communication skills Ability to work independently in a contract setting #J-18808-Ljbffr

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:24 min

Distributed data lakes and containerized computing clusters

Ulrich Wurstbauer +1 · LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

1:43 min

AWS infrastructure stack and data flow pipeline overview

Artem Volk Artem Volk +1 · World Congress 2024

3:44 min

Automating storage savings with S3 intelligent tiering

Sébastien Stormacq · World Congress 2021

Videos

See all

Related articles

See all