Senior Developer - Hadoop & Snowfalke
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
Design and implement Hadoop MapReduce jobs for complex data processing tasks. Utilize HiveQL for querying and manipulating large datasets within Hadoop. Leverage Spark for real-time data processing and streaming analytics when needed.
Snowflake Development: Design efficient data models in Snowflake to optimize query performance and data access. Create Snowflake views and materialized views to enhance query efficiency for data analysis. Implement data governance policies within Snowflake to ensure data quality and security. Write complex SQL queries on Snowflake to extract insights from large datasets.
Requirements
Programming Languages: Strong proficiency in Python, Java, and SQL. Big Data Frameworks: Deep understanding of ecosystem (HDFS, MapReduce, Hive, Spark, pyspark, snowspark). Cloud Data Warehousing: Expertise in Snowflake architecture, data manipulation, and query optimization. Data Engineering Concepts: Knowledge of data ingestion, transformation, data quality checks, and data security practices. Data Modeling: Ability to design efficient data models for data warehousing environments
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦