Data Engineer

Collaborate Solutions Inc
Columbia, United States of America
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Columbia, United States of America

Tech stack

Agile Methodologies
Artificial Intelligence
ARM
Cloud Storage
Information Engineering
Data Integration
ETL
Data Warehousing
IBM DB2
Key Management
Microsoft SQL Server
MongoDB
Scrum
Data Streaming
Azure
Snowflake
Data Management
Guidewire
Databricks

Job description

  • Lead the design, and implementation of enterprise data warehouses from the ground up.
  • Work with business stakeholders to understand insurance data domains such as policies, quotes, and claims.
  • Implement end to end data platform migration from On-prem SQL Server to Snowflake.
  • Develop and maintain data pipelines, ETL/ELT processes, and data integration workflows using Azure Data Factory (ADF), Databricks, and Storage Accounts and Azure Key Vault.
  • Integrate and manage data across multiple sources including MongoDB, DB2, Guidewire Systems and CRM/MDM systems.
  • Provide technical leadership, mentoring, and guidance to team members while contributing as an independent contributor.
  • Work in Agile development environments, participating in sprint planning, stand-ups, and retrospectives.
  • Ensure data quality, governance, and security standards are maintained across all platforms.

Requirements

We are seeking a highly experienced Data Engineer with 10+ years of experience. The ideal candidate will have deep expertise in designing, architecting, and building data warehouses from scratch, and hands-on proficiency with both cloud and on-premises data platforms., * 10+ years of professional experience in data engineering, data warehouse development, or related roles.

  • Insurance industry experience, specifically with policies, quotes, claims, or related domains.

  • Proven ability to design, architect, and build data warehouses from scratch.

  • Hands-on experience with Azure Data Stack:

  • ADF (pipelines, orchestration, data flows)

  • Databricks

  • Storage Accounts

  • Key Vaults

Hands-on experience with Snowflake (SnowSQL, Snowpark, Snow pipe, Streams & Tasks, Dynamic Tables, Cortex AI).

Experience with On-Prem SQL Server, MongoDB, and DB2.

Experience in Agile development environments.

Ability to work independently while providing leadership to projects and teams.

Apply for this position