Hadoop Architect

Seeking a Senior Specialist with 7 to 11 years of experience in Data Architecture to provide data driven solutions, Looking for someone who is familiar with the below areas and Design develop and maintain robust data architecture frameworks to support data requirements and translate them into scalable data solutions Skills: HDFS Architecture, Name Node High Availability HA, HDFS Federation, Rack Awareness, HDFS Read Write Flow, YARN Architecture, Capacity Scheduler, Fair Scheduler, Resource Management Queue Design, Map Reduce Architecture, Shuffle and Sort, Apache Spark Architecture, Spark DAG Execution Plan, Spark Performance Tuning, Memory Management in Spark, Adaptive Query Execution AQE, Hive Architecture, Hive Metastore, Hive Optimization Techniques, Partitioning Bucketing ORC Parquet Internals, Impala Architecture, Apache Kafka Architecture, Kafka Performance Tuning, Kafka Security, Streaming Architectures, CDC Change Data Capture, Apache Airflow Architecture, Workflow Orchestration, Data Lake Architecture, Lakehouse Architecture, Delta Lake Fundamentals, Data Modelling for Big Data, ETLELT Framework Design, Data Governance, Data Lineage, Metadata Management, Kerberos Authentication, Apache Ranger, Apache Knox, Encryption Security Best Practices, Cloudera CDP Architecture, AWS EMR, AWS Glue S3 Architecture Optimization, Databricks Architecture, CICD for Data Pipelines, Monitoring Observability, Logging Frameworks, Cluster Sizing Capacity Planning, Disaster Recovery DR, Backup Recovery Strategies, High Availability Design, Multitenancy Design, Data Quality Frameworks, Performance Troubleshooting, Data Skew Handling Join Optimization Techniques Small File Problem, Cost Optimization, Real-time Data Pipeline Design, Batch Processing Architecture, Event Driven Architecture, Lambda Architecture, End-to-end Solution Architecture, Migration from OnPrem Hadoop to Cloud, Scalability Reliability Design Patterns, System Design for Big Data Platforms, Architecture Trade-offs and Decision Making, SQL, PySpark Scala Coding, Job Description In the assigned Job Role of Architecture Consultant 2, your Area Of Responsibility will be as below: Participate in customer discussions to gather and analyze…

• 17 hours ago

Job Summary Seeking a Senior Specialist with 7 to 11 years of experience in Data Architecture to provide datadriven solutions Job Description Looking for someone who is familia…