Technical Lead - Hadoop
Wipro Limited
Newark, United States of America
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 135KJob location
Newark, United States of America
Tech stack
API
Audit Trail
User Authentication
Azure
Big Data
Cloud Computing
Configuration Management
ETL
Data Structures
DevOps
Hadoop
Hadoop Distributed File System
HBase
Hive
Label Switching Router (MPLS Networking)
Machine Learning
Open Source Technology
Performance Tuning
RabbitMQ
Shell Script
Security Information and Event Management
Apache Zookeeper
Apache Yarn
System Availability
Grafana
Spark
Kubernetes
Deployment Automation
Kafka
Puppet
Tez (Software)
Ambari
Jenkins
Microservices
Job description
- Candidate has proficiency all tenets of being an enterprise solutions architect and should have fluency in.
- Platform management experience at scale with Big data Hadoop components (HDFS, Yarn, Storm, HBASE, Hive, Spark, RabbitMQ, Ambari, Zoo Keeper, Grafana, Kafka, Zoo Keeper etc..,).
- real-time ingestion/streaming options for large data set flows
- with hands-on experience in designing, building & deploying big data solutions On-prem & Cloud (Azure) & Hybrid solutions.
- Performance tuning (for eg. Yarn is slow, Tez jobs are slow, Slow Data loading) & maintain platform integrity.
- Industry best practices & recommendations review and roll out as appropriate
- Security compliance.
- Manage & maintain layered access through Authentication, Authorization, and Auditing.
- Addition and maintenance of user access for both new and existing users.
- Maintain & manage High Availability.
- Manage permissions and roll over Ranger KMS keys.
- Monitor the Automated Audit forwarding Job.
- Audit Log Clean up as directed by security information and event management (SIEM) system.
- Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Linux scripting.
- Consumption of Big Data
- a. Aggregation strategies
- b. Micro service architecture
- c. Subscription model
- d. API (Rest, graphql)
- e. Modeling for Insight/KPI factory
- f. Product Development
- Digital 360
- a. Tooling- Jenkins, Dockers, Kubernetes, DevOps etc.
- b. Process-
- c. Methodologies- safe Agile
- Working knowledge of Machine learning (good to have)
- Telco Domain Knowledge (Preferable)
- a. Big Data relative to Telecom (a. Understanding Key Data Element- EDR,CDR, LSR; b. Product Development for consumption from the Key data element)
Requirements
Do you have experience in ZooKeeper?
Benefits & conditions
Pulled from the full job description
- Health insurance
- Paid time off
- Dental insurance
- Disability insurance, Mandatory Skills: Hadoop Cloudera .
Experience: 5-8 Years .
The expected compensation for this role ranges from $60,000 to $135,000 .
Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro's standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options.
About the company
Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com.