Data Engineer
Hire IT People
1 month ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Remote
Tech stack
Data Systems
Fault Tolerance
Data Delivery
Data Pipelines
Job description
- Responsible to design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science
- Responsible to teach, adhere to, and contribute to DataOps and MLOps standards and best practices to accelerate and continuously improve data system performance
- Responsible to design, and integrate fault tolerance and enhancements into data pipelines to improve quality and performance
- Responsible to lead and perform root cause analysis and solve problems using analytical and technical skills to optimize data delivery and reduce costs
- Engages business end users and shares responsibility leading a delivery team.
- Responsible to mentor Data Engineers at all levels of experience
Requirements
- 7+ years of experience as a Data Engineer
- Advanced experience building Databricks platforms
- Advanced experience with SQL and Python
- Experience pulling data from SAP
- Advanced experience with Azure synapse
- Experience with Azure DevOps, GitHub, and CI/CD pipelines
- Strong communication skills and ability to present conceptual and technical improvements to influence decisions
