Lead Data Engineer
Role details
Job location
Tech stack
Job description
work from Home Key Responsibilities Feature development, issue resolution, and daily monitoring on cloud delta lakehouse data platform. Operate as part of an agile technical team participating in all agile team ceremonies such as daily stand up meetings and backlog refinement sessions. Lead Architectural decisions, mentor junior engineers and contribute to establishing engineering standards, documentation, and reusable frameworks. Experience Overall 10+yrs experience in data engineering. At least five years of experience working in a data warehouse solution landscape. Proven ability to lead complex data initiatives and drive architectural decisions. Experienced with agile delivery methodologies, ideally SCRUM/Kanban. Be able to assume ownership of data issues, perform investigation and root cause analysis, and implement remediation through code and data changes. Understanding of data warehouse testing strategies and quality assurance processes., Good understanding of git branching, The role involves feature development, issue resolution, and daily monitoring on a cloud delta lakehouse data platform while operating within an agile technical team structure. Key duties include leading architectural decisions, mentoring junior engineers, and establishing engineering standards and reusable frameworks.
Requirements
Data Engineering, Feature Development, Issue Resolution, Cloud Delta Lakehouse, Agile, Architectural Decisions, Mentoring, Engineering Standards, Data Warehouse, Root Cause Analysis, Data Quality Assurance, Git Branching Strategies, Azure DevOps, Communication, SQL Server, PySpark, strategies and code management, Good understanding of technical release management processes in Azure DevOps. Confident and concise communication skills, with the ability to drive alignment, collaboration, and efficiency within teams. Qualifications A bachelor's or master's degree in computer science, data management, information systems industry approved; relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications) Additional Information Tech Stack SQL Server, SSIS, T-SQL ADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lake