Azure Data Lead

Hptech Inc.
Fremont, CA, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Business Analytics Applications Microsoft Azure Computer Programming Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Systems Data Visualization Data Warehousing Database Design Database Queries
+12 more
Apache Hive Python (Programming Language) Oracle SQL Developer SQL Databases Data Processing Azure Data Factory Apache Spark Pyspark Data Management Data Pipelines Databricks Web Api

Job description

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices., 1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

  1. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.
  2. Design and develop etl processes, data models, and data integration solutions.
  3. Provide technical guidance and mentorship to the team members.
  4. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.
  5. Troubleshoot and optimize data pipelines and processes for performance and efficiency.
  6. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.

Requirements

  1. 10 + years of proven experience with ETL/ELT( Structure & unStructure , API’s), SQL, PySpark, schema design and dimensional data modelling, medallion architecture

  2. Solid knowledge of data warehouse best practices, development standards and methodologies

  3. Strong experience with big data tools(Databricks , Spark ) and programming skills in PySpark and Spark SQL.

  4. Be an independent self-learner with β€œlet’s get this done” approach and ability to work in Fast paced and Dynamic environment., 1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.
  5. Strong experience with sql and oracle pl/sql for data querying and manipulation.
  6. Advanced programming skills in python for scripting and data processing tasks.
  7. Knowledge of data modeling, data warehousing concepts, and database design principles.
  8. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
  9. Strong analytical and problem-solving skills with attention to detail.
  10. Experience in data visualization tools and techniques is a plus.

Other Requirements

1.Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…