Snowflake & Hadoop Developer/ Lead
Robotics Technologies LLC
Plano, TX, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$153,920
Working hours
Regular working hours
Job source
Tech stack
Query Performance
Java (Programming Language)
Data Analysis
Big Data
Cloud Database
Data Validation
Information Engineering
Data Security
Data Warehousing
Apache Hadoop
Hadoop Distributed File System
MapReduce
+12 more
Apache Hive
Python (Programming Language)
Query Optimization
Standard Sql
Data Processing
Freeform SQL
Data Ingestion
Snowflake
Apache Spark
Pyspark
Stream Processing
Programming Languages
Job description
- Design and implement Hadoop MapReduce jobs for complex data processing tasks.
- Utilize HiveQL for querying and manipulating large datasets within Hadoop.
- Leverage Spark for real-time data processing and streaming analytics when needed.
Snowflake Development:
- Design efficient data models in Snowflake to optimize query performance and data access.
- Create Snowflake views and materialized views to enhance query efficiency for data analysis.
- Implement data governance policies within Snowflake to ensure data quality and security.
- Write complex SQL queries on Snowflake to extract insights from large datasets.
Requirements
- 10 years of strong experience in development with at least 2 years of experience into leading a team
- Very strong in Snowflake
- Strong Hadoop migration experience
- Programming Languages: Strong proficiency in Python, Java and SQL
- Big Data Frameworks: Deep understanding of ecosystym (HDFS, MapReduce, Hive, Spark, PySpark, Snowspark)
- Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation and query optimization
- Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks and data security practices.
- Data modeling: Ability to design efficient data models for data warehousing environments.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦