Azure Data Engineer

Stellar Professionals
Indianapolis, IN, United States
2 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Microsoft Azure Continuous Integration Information Engineering Data Governance Data Integration Extract Transform Load (ETL) Data Warehousing DevOps Apache Hive Role-Based Access Control Azure Data Lake SQL Databases
+12 more
Data Streaming Parquet Azure Data Factory Apache Spark Git Data Lakes Pyspark Information Technology Azure Synapse Analytics Data Pipelines Serverless Computing Databricks

Job description

We are seeking a Data Scientist / Data Engineer to design, build, and maintain secure, scalable data solutions using Azure Databricks and Azure Synapse Analytics. You will build batch and streaming data pipelines, optimize data warehouse workloads, and implement data governance standards to deliver high-quality, reliable data products., * Azure Databricks: PySpark, Spark SQL, Delta Lake, Medallion Architecture (Bronze/Silver/Gold), Unity Catalog

  • Azure Synapse Analytics: Dedicated & Serverless SQL pools, MPP architecture, Star-Schema Data Modeling (SCD Type 1/2)
  • Data Integration & Pipelines: ETL/ELT, Auto Loader, Structured Streaming, Azure Data Factory (ADF), Databricks Workflows

Engineering & Operations:

  • Data Lake & Storage: ADLS Gen2, Parquet/Delta formats, Schema Enforcement/Evolution, Time Travel
  • DevOps & CI/CD: Git, Azure DevOps, Databricks Asset Bundles, Branching & PRs
  • Performance & Governance: Cluster right-sizing, Spark UI troubleshooting, HIPAA/PHI/PII security, Role-Based Access Control (RBAC)

Requirements

  • Master’s degree in Data Science, Computer Science, or related field; OR Bachelor’s degree + 2+ years of relevant experience; OR 4+ years of hands-on data engineering experience.
  • Preferred Certifications: Databricks Certified Data Engineer Associate/Professional or Microsoft Certified: Azure Data Engineer Associate (DP-203).

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…