Big Data Lead (Snowflake/Python)

Here Technologies
Parsippany-Troy Hills, United States of America
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Parsippany-Troy Hills, United States of America

Tech stack

Airflow
Big Data
Computer Programming
Continuous Integration
Data Infrastructure
ETL
Data Warehousing
Python
Open Source Technology
SQL Databases
Data Processing
Snowflake
Spark
Software Application Programming
GIT
Kubernetes
Amazon Web Services (AWS)
Jenkins
Databricks

Requirements

  1. 10+ years of relevent experience in developing applications using snowflake, snow SQL , snowpipe , using Snowflake for ETL and storage

  2. Profound experience with developing and designing Big Data applications using Spark/Python and snowflake.

  3. Very good experience working with Python Core programming language in data processing

  4. Good experience in Airflow and Kubernetes.

  5. Develop highly scalable and extensible Big Data platform which enables collection, storage, modelling, and analysis of massive data sets from numerous data sources.

  6. Should have very good knowledge on SQL Programming and ETL Data Warehousing concepts.

  7. Good understanding of CI/CD process, Git, Jenkins.

Note: Need strong experience in Snowflake, python and SQL. Experience with other technologies like data bricks, AWS glue, Open-source Spark will not be accounted for this role

Apply for this position