Data Platform Engineer (Azure Synapse / Databricks / Apache Spark & Scala
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+30 more
Job description
We are looking for a hands-on Technical Lead Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will be responsible for designing, building, modernizing, and operating enterprise-scale data platforms and services on Microsoft Azure. Required Skills
- Azure Databricks
- Azure Synapse Analytics
- Apache Spark / PySpark
- Scala
- Azure Data Factory (ADF)
- Azure Data Lake Storage Gen2 (ADLS Gen2)
- Delta Lake
- SQL Server / Azure SQL
- Cosmos DB
- Kusto / Azure Data Explorer
- ETL/ELT Pipelines
- Data Warehousing and Data Modeling
- Lakehouse / Medallion Architecture
- Data Quality, Reconciliation, and Governance
Key Responsibilities Data Platform & Engineering
- Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.
- Develop large-scale data processing solutions using Azure Databricks, Spark/PySpark, Azure Synapse, and Azure Data Factory.
- Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers.
Backend Services & Integration
- Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
- Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
- Implement microservices and event-driven processing patterns with secure authentication and authorization.
Modernization & Reliability
- Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
- Support platform and data migrations while ensuring functional and data parity.
- Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights.
Cloud, DevOps & Technical Leadership
- Build and maintain CI/CD pipelines using Azure DevOps and Git.
- Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.
- Support Docker and Kubernetes/AKS-based workloads where applicable.
Requirements
Candidates should have strong hands-on experience in enterprise Azure data engineering, distributed data processing, backend services, cloud architecture, and production operations.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦