Snowflake Lead Data Engineering

Northern Base
New York, NY, United States
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Training Data Artificial Intelligence Amazon Web Services Data Analysis ARM Architecture Cyber Security Continuous Integration Data Validation Information Engineering Extract Transform Load (ETL) Data Masking Fraud Prevention and Detection
+22 more
Python (Programming Language) Machine Learning NumPy Performance Tuning Query Optimization Role-Based Access Control Azure Machine Learning SQL Databases Talend Data Processing Cloud Platform System Feature Engineering Data Ingestion Sql Optimization Snowflake Pandas Scikit Learn Data Analytics Qlikview Star Schema Machine Learning Operations Databricks

Job description

Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend ETL Roles & Responsibilities The Snowflake Lead will serve as the onsite technical lead for CLEARBROOK ‘s enterprise data platform, responsible for end to end Snowflake solution design, development leadership, and AI/advanced analytics enablement. The role requires deep hands on expertise in Snowflake, strong data engineering fundamentals, and the ability to integrate AI/ML driven use cases into the Snowflake ecosystem while coordinating with offshore teams. Snowflake Production Support Perform root cause analysis for job failures and data analysis & fixes Perform Month End Closing Activities Snowflake Development & Architecture Lead design and development of Snowflake schemas, tables, views, streams, tasks, and Snowpipes Define and enforce best practices for performance optimization (warehouse sizing, clustering, query tuning) Own Snowflake security architecture: RBAC, role hierarchy, data masking, row/column level security Oversee promotion of code across environments using CI/CD practices Data Engineering & Integration Lead development of batch and near real time ingestion pipelines using Talend / Qlik Replicate / Snowpipe Ensure data quality checks, reconciliation, and schema drift handling Guide integration from insurance source systems (Policy, Claims, Billing, Reinsurance) into Snowflake Provide technical oversight for SQL, Python, and ELT based transformations AI / Advanced Analytics Enablement Enable AI/ML use cases on Snowflake, including: o Feature engineering datasets for ML models o Snowpark (Python) based data processing o Integration with external ML platforms (Databricks / SageMaker / Azure ML where applicable) Support AI driven insights such as: o Claims triage & risk scoring o Fraud detection inputs o Premium leakage and pricing analytics Guide teams in using Python, SQL, and Snowflake native capabilities for data science workloads

Requirements

Snowflake: Advanced SQL, Performance Tuning, Security, Snowpipe, Streams & Tasks Data Engineering: ELT/ETL patterns, data modeling, CDC concepts Python: Data processing, automation, Snowpark (preferred) Strong understanding of cloud data platform architecture (AWS preferred) AI / Analytics Skills Hands on exposure to AI/ML pipelines (feature preparation, training data creation) Experience supporting ML models through data engineering and operationalization Familiarity with Python ML libraries (scikit learn, pandas, NumPy) applied from a data engineering perspective Understanding of model lifecycle support (data refresh, monitoring, retraining inputs) Domain & Soft Skills Insurance domain experience (P&C / Specialty Insurance strongly preferred) Strong communication skills for onsite customer interaction Ability to translate business requirements into scalable data & AI solutions

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:34 min

Maximizing execution memory effectively via python numpy broadcasting

Jodie Burchell · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · WWC 2024

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

1:25 min

Replacing NumPy with cuPy for straightforward GPU acceleration

Paul Graham Paul Graham · WWC 2025

6:58 min

Analyzing production code coverage data using pandas

Markus Harrer Markus Harrer · WWC 2021

Videos

See all

Related articles

See all