Data & Analytics (Hadoop + Big Data)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Requirements
Apache Hadoop, Big Data, Data Analysis, Apache Hadoop, Ecosystems, Big Data, Enterprise Architecture, HDFS (Hadoop Distributed File System), Apache Spark, Python Programming/Scripting Language, Β· 14+ years of experience in Enterprise Data Architecture, Hadoop Ecosystem, Big Data Engineering, and Data Platform Modernization. Β· Strong hands-on expertise in Hadoop, HDFS, YARN, Hive, Spark, PySpark, Kafka, SQL, Python, Java, and Scala. Β· Experience designing and implementing large-scale Big Data and Data Lake architectures supporting analytics, reporting, and AI workloads. Β· Strong understanding of Hadoop platform architecture, including HDFS, YARN, high availability, cluster management, workload optimization, and scalability. Β· Expertise in batch and distributed data processing using Spark, Hive, HBase, and MapReduce frameworks. Β· Experience building data ingestion and streaming solutions using Kafka and Hadoop ecosystem tools. Β· Strong knowledge of Data Engineering practices, including ETL/ELT, data integration, data quality, metadata management, lineage, observability, and DataOps. Β· Experience with Data Lake, Data Warehousing, Enterprise Data Models, Master Data, and Data Governance frameworks. Β· Strong understanding of security and governance controls, including Kerberos, Ranger, encryption, privacy, auditability, compliance, and controlled data access.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦