Lead Snowflake Data Engineer

Infinity Quest
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 58K

Job location

Tech stack

Query Performance
Artificial Intelligence
Apache HTTP Server
Cluster Analysis
ETL
Data Masking
Data Mining
Data Warehousing
Dimensional Modeling
Hive
JSON
Simple Data Format
SQL Stored Procedures
SQL Databases
XML
Sql Optimization
Snowflake
PySpark
Semi-structured Data
Star Schema
Data Management
Data Pipelines
Legacy Systems
Databricks

Job description

  • Collaborating with cross-functional teams to ensure seamless initiative execution and meet customer requirements.
  • Acting as a technical point of contact for customers, addressing their concerns and providing technical guidance and support.
  • Troubleshooting technical issues and implementing effective solutions to enhance customer satisfaction

Snowflake Development

  • Create and manage snowflake objects (tables, views, stages , file formats)
  • Integrate with Databricks, Apache sparkSQL , Pyspark
  • Implement Snowflake features like streams, tasks , snowpipe
  • Implement Time travel and Fail-safe
  • Clustering and Partitioning
  • Optimize Query performance
  • Creating internal and external stages
  • Historical bulk data movement
  • Data masking
  • Stored procedures and UDFs
  • Integration with tools like Databricks
  • Keen to use claude code or ai tools

Requirements

  • 10-12 years of industry experience in BFSI banking and preferred in wealth management for atleast 2 years

  • Experience of at least 7-10 years in Datawarehouse/data management projects

  • Design and implement end-to-end migration pipelines from legacy systems to snowflake

  • Develop scalable ETL/ELT pipelines using snowflake , SQL , Spark SQL etc.

  • Perform data extraction, transformation, and loading with a focus on performance and scalability

  • Handle structured and semi-structured data (JSON , XML)

  • Advanced SQL skills (complex joins , window functions, optimizations )

  • Must have Datawarehouse concepts , star schema , snowflake schema

  • Knowledge on Dimensional models , SCD-1, SCD-2 , SCD-3

  • Design cloud based solutions adapted to our customer requirements, * Strong English (written and spoken).

  • Attention to detail

  • Good business knowledge

  • A proactive person that has a forward-thinking mindset, actively seeks solutions, and takes steps to achieve desired outcomes.

  • A responsible individual demonstrates reliability, integrity, and a commitment to meeting their commitments and fulfilling their duties.

  • Ability to manage multiple workstreams and priorities

Apply for this position