Data Engineer
N Consulting Ltd
1 month ago
Role details
Contract type
Temporary to permanent Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Remote
Tech stack
Amazon Web Services (AWS)
Data Governance
Data Integrity
ETL
Data Security
Python
SQL Databases
Data Streaming
PySpark
Data Pipelines
Databricks
Requirements
- Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams.
- Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark.
- Must have hands-on experience with PySpark, Python, AWS, data modelling.
- Must have experience in ETL processes.
- Must have hands-on experience in Databricks development.
- Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures.
- Must have hands-on experience in SQL development.
- Excellent communication skills & logical thinking.
