Principal - Data Engineering
Role details
Job location
Tech stack
Job description
Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance project The ideal candidate will have deep expertise in Azure cloud services Azure Data Factory and Databricks with a strong understanding of data modeling data integration and analytics in the insurance domain
Key Responsibilities
-
Architect and design end to end data solutions on Azure for insurance related data workflows
-
Lead data ingestion transformation and orchestration using ADF and Databricks
-
Collaborate with business stakeholders to understand data requirements and translate them into technical solutions
-
Ensure data quality governance and security compliance across the data lifecycle
-
Optimize performance and cost efficiency of data pipelines and storage
-
Provide technical leadership and mentoring to data engineers and developers
Requirements
Do you have experience in Underwriting?, Experience Level 15 years with at least 5 years in Azure ecosystem, * Azure Cloud Services Strong experience with Azure Data Lake Azure Synapse Azure SQL and Azure Storage
-
Azure Data Factory ADF Expertise in building and managing complex data pipelines
-
Databricks Handson experience with Spark based data processing notebooks and ML workflows
-
Data Modeling Proficiency in conceptual logical and physical data modeling
-
SQL Python Advanced skills for data manipulation and transformation
-
Insurance Domain Knowledge Understanding of insurance data structures claims policy underwriting and regulatory requirements
Preferred Skillset:
-
Power BI Experience in building dashboards and visualizations
-
Data Governance Tools Familiarity with tools like Purview or Collibra
-
Machine Learning Exposure to ML model deployment and monitoring in Databricks
-
CICD Knowledge of DevOps practices for data pipelines
Certifications: Azure Data Engineer or Azure Solutions Architect certifications Skills
Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight