Remote Senior Data Engineer
N Consulting Ltd
Central Milton Keynes, United Kingdom
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Central Milton Keynes, United Kingdom
Tech stack
Amazon Web Services (AWS)
Data Governance
Data Integrity
ETL
Data Transformation
Database Development
Python
Data Streaming
PySpark
Data Pipelines
Databricks
Requirements
Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands on experience in SQL development Excellent Communication skills & Logical thinking