Databricks Certified Data Engineer Associate

Randstad
New York, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 166K

Job location

New York, United States of America

Tech stack

.NET
Azure
Google BigQuery
C Sharp (Programming Language)
Data Architecture
Data Governance
ETL
Data Security
Identity and Access Management
Python
Network Security
Machine Learning
Meta-Data Management
SQL Azure
Power BI
Azure
SQL Stored Procedures
SQL Databases
Google Cloud Platform
Azure
Data Lake
PySpark
Data Lineage
Cosmos DB
Azure
Data Pipelines
Serverless Computing
Databricks

Job description

2.Azure Data Engineer: Design, implement, and maintain data solutions using Azure cloud services. Develop ETL processes, optimize data pipelines, and ensure data quality and security. Collaborate with teams to deliver scalable data architecture supporting analytics and business intelligence.

Requirements

The candidate should have hands-on experience with various Azure services including but not limited to

Azure Data Factory, Databricks, Data Lake, and Power BI.

They should be able to design, build, and maintain ETL pipelines, manage data lakes,

and create insightful reports and visualizations.

Experience with Azure SQL Database, Azure Synapse Analytics, Azure COSMOS DB , Azure ML, other Azure services is a plus.

SQL skill is a must to have And .NET C# skills will be a great plus., The candidate should have a strong understanding of security protocols within the Azure platform.

This includes knowledge of identity and access management, network security,

encryption methods, secure data communication, and securing serverless architectures.

4.Data Governance:

The candidate should have experience in implementing data governance strategies.

This includes setting up data governance frameworks, defining data ownership,

ensuring data quality, and implementing data privacy and compliance measures.

Knowledge of data cataloging, data lineage, and metadata management is also important.

5.Certifications: Azure certifications such as Azure Security Engineer Associate, or Azure Solutions Architect Expert are highly desirable. Databricks Certified Data Engineer Associate is required. Databricks Machine Learning Certificate

TECHNICAL SKILLS

Must Have

Ability to intrepid, modify and write scripts and SQL queries

Azure Cloud Data Engineer

Azure Databricks

Azure Data Factory

PowerBi Report Server

PySpark

Python

Nice To Have

3+ years of experience with creating stored procedures in SQL

Google Cloud BigQuery, Google Cloud Experience, The candidate should have a strong understanding of security protocols within the Azure platform.

This includes knowledge of identity and access management, network security,

encryption methods, secure data communication, and securing serverless architectures.

4.Data Governance:

The candidate should have experience in implementing data governance strategies.

This includes setting up data governance frameworks, defining data ownership,

ensuring data quality, and implementing data privacy and compliance measures.

Knowledge of data cataloging, data lineage, and metadata management is also important.

5.Certifications: Azure certifications such as Azure Security Engineer Associate, or Azure Solutions Architect Expert are highly desirable. Databricks Certified Data Engineer Associate is required. Databricks Machine Learning Certificate

TECHNICAL SKILLS Must Have

  • Ability to intrepid, modify and write scripts and SQL queries
  • Azure Cloud Data Engineer
  • Azure Databricks
  • Azure Data Factory
  • PowerBi Report Server
  • PySpark
  • Python, Ability to intrepid, modify and write scripts and SQL queries

Azure Cloud Data Engineer

Azure Databricks

Azure Data Factory

PowerBi Report Server

PySpark

Python

Nice To Have

3+ years of experience with creating stored procedures in SQL

Google Cloud BigQuery, Google Cloud Experience

Apply for this position