Data Snowflake Engineer

VDart, Inc.

Austin, TX, United States

4 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$150,000.0 - $250,000.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Airflow Amazon Web Services Amazon S3 Cloud Computing Continuous Integration Directed Acyclic Graph (Directed Graphs) Information Engineering Data Integrity Extract Transform Load (ETL) Data Systems Data Warehousing Software Debugging

+18 more

Dimensional Modeling JSON Python (Programming Language) Performance Tuning SQL Stored Procedures Parquet Data Ingestion Snowflake Git Cloudformation Pyspark Semi-structured Data Information Technology Data Management Streamlit Framework Terraform Data Pipelines Jenkins

Job description

We are seeking a highly skilled Data Engineer with strong expertise in Snowflake, Python, PySpark, Airflow, and Streamlit to design, build, and support modern cloud-based data platforms. The ideal candidate will have experience developing scalable data pipelines, implementing Snowflake-based data solutions, and working with GCP environments., Design, develop, and maintain data ingestion, transformation, and orchestration pipelines in Snowflake. Build and optimize Snowflake SQL queries, stored procedures, data models, and Snowpark-based solutions. Develop scalable ETL/ELT processes using Python and PySpark. Create and manage Airflow DAGs for workflow scheduling, monitoring, and automation. Develop interactive dashboards and data applications using Streamlit. Work with structured and semi-structured data formats including JSON, CSV, and Parquet. Design and implement data quality, validation, reconciliation, and monitoring frameworks. Integrate Snowflake solutions with AWS cloud services. Troubleshoot production issues, optimize performance, and ensure data reliability. Collaborate with business stakeholders, architects, and cross-functional teams to deliver data solutions., Job Description: We are seeking a highly skilled Data Engineer with strong expertise in Snowflake, Python, PySpark, Airflow, and Streamlit to design, build, and support modern cl…

18 hours ago
Apply easily

Requirements

8+ years overall Data Engineering experience Strong hands-on experience with Snowflake including: o Data ingestion and transformation o Snowflake SQL o Complex joins and performance tuning o Stored Procedures, Views, Tasks, and Streams o Snowpark libraries o Data Modeling 5+ years of Python development experience Strong knowledge of PySpark Hands-on experience with Apache Airflow Hands-on experience with Streamlit Experience with GCP Strong understanding of data warehousing concepts, ETL/ELT, and dimensional modeling. Experience working with large-scale structured and semi-structured datasets. Strong analytical, debugging, and problem-solving skills. Preferred Qualifications Experience in Banking or Financial Services environments. Exposure to AWS services such as S3, EMR, Redshift, or equivalent GCP services. Experience with CI/CD, Git, Jenkins, Terraform, or CloudFormation. Snowflake and Cloud certifications are a plus., Bachelor’s or master’s degree in computer science, Information Technology, Engineering, or a related field.

Benefits & conditions

$150,000-250,000 per year Opportunity to join the industries top AI Consulting firm, building out both traditional machine learning and cutting-edge generative AI projects of the future! This Jobot Job is…
3 days ago + *