Senior Data Engineer
N Consulting Ltd
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 48KJob location
Tech stack
Amazon Web Services (AWS)
Data Governance
Data Integrity
ETL
Data Security
Python
SQL Databases
Data Streaming
PySpark
Data Pipelines
Databricks
Requirements
Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands on experience in SQL development Excellent Communication skills & Logical thinking
