Azure Data Lead
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices., 1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
- Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.
- Design and develop etl processes, data models, and data integration solutions.
- Provide technical guidance and mentorship to the team members.
- Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.
- Troubleshoot and optimize data pipelines and processes for performance and efficiency.
- Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.
Requirements
-
10 + years of proven experience with ETL/ELT( Structure & unStructure , APIβs), SQL, PySpark, schema design and dimensional data modelling, medallion architecture
-
Solid knowledge of data warehouse best practices, development standards and methodologies
-
Strong experience with big data tools(Databricks , Spark ) and programming skills in PySpark and Spark SQL.
- Be an independent self-learner with βletβs get this doneβ approach and ability to work in Fast paced and Dynamic environment., 1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.
- Strong experience with sql and oracle pl/sql for data querying and manipulation.
- Advanced programming skills in python for scripting and data processing tasks.
- Knowledge of data modeling, data warehousing concepts, and database design principles.
- Ability to work in a collaborative team environment and communicate effectively with stakeholders.
- Strong analytical and problem-solving skills with attention to detail.
- Experience in data visualization tools and techniques is a plus.
Other Requirements
1.Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦