Snowflake & Hadoop Developer/ Lead

Robotics Technologies LLC
Plano, TX, United States
1 day ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$153,920
Working hours
Regular working hours
Job source

Tech stack

Query Performance Java (Programming Language) Data Analysis Big Data Cloud Database Data Validation Information Engineering Data Security Data Warehousing Apache Hadoop Hadoop Distributed File System MapReduce
+12 more
Apache Hive Python (Programming Language) Query Optimization Standard Sql Data Processing Freeform SQL Data Ingestion Snowflake Apache Spark Pyspark Stream Processing Programming Languages

Job description

  • Design and implement Hadoop MapReduce jobs for complex data processing tasks.
  • Utilize HiveQL for querying and manipulating large datasets within Hadoop.
  • Leverage Spark for real-time data processing and streaming analytics when needed.

Snowflake Development:

  • Design efficient data models in Snowflake to optimize query performance and data access.
  • Create Snowflake views and materialized views to enhance query efficiency for data analysis.
  • Implement data governance policies within Snowflake to ensure data quality and security.
  • Write complex SQL queries on Snowflake to extract insights from large datasets.

Requirements

  • 10 years of strong experience in development with at least 2 years of experience into leading a team
  • Very strong in Snowflake
  • Strong Hadoop migration experience
  • Programming Languages: Strong proficiency in Python, Java and SQL
  • Big Data Frameworks: Deep understanding of ecosystym (HDFS, MapReduce, Hive, Spark, PySpark, Snowspark)
  • Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation and query optimization
  • Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks and data security practices.
  • Data modeling: Ability to design efficient data models for data warehousing environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…