Senior Data Engineer - Spark / Snowflake / Python
Wise Skulls llc
Austin, TX, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source
Tech stack
Airflow
Amazon Web Services
Microsoft Azure
Cloud Computing
Information Engineering
Data Governance
Extract Transform Load (ETL)
Data Transformation
Data Visualization
Database Queries
Python (Programming Language)
Meta-Data Management
+15 more
Performance Tuning
SQL Databases
Workflow Management Systems
Data Processing
Google Cloud
Application Enhancement Tool
Large Language Models
Snowflake
Apache Spark
Agentic-AI
Git
Pyspark
Data Analytics
Model Context Protocol
Data Pipelines
Job description
We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Apache Spark, PySpark, Snowflake, SQL, and Python. The ideal candidate will be responsible for developing, optimizing, and maintaining scalable data pipelines and working with modern data engineering technologies., * Design, develop, and maintain scalable data pipelines using Spark and Snowflake.
- Build and optimize ETL/ELT workflows using Python and SQL.
- Perform data transformations, integration, and quality checks.
- Optimize queries and data processing workflows for performance.
- Collaborate with cross-functional teams to support data analytics and reporting.
- Explore and leverage AI-powered tools and emerging technologies in data engineering.
Requirements
- 5-8 years of experience in Data Engineering.
- Strong hands-on experience with Apache Spark and PySpark.
- Solid experience with Snowflake, including data loading and transformation.
- Strong SQL skills and basic-to-intermediate Python programming.
- Experience developing and maintaining ETL/ELT data pipelines.
- Understanding of data processing, data modeling, and performance optimization.
- Exposure to AI-powered tools for data visualization and dashboard development.
- Basic awareness of AI agents, LLM tools, and Model Context Protocol (MCP).
Preferred Skills
- Experience with Apache Airflow or other workflow orchestration tools.
- Cloud experience with AWS, Azure, or Google Cloud Platform.
- Familiarity with Git and CI/CD pipelines.
- Knowledge of data governance and data cataloging.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦