Cloudera Developer
Genesis10
Charlotte, United States of America
yesterday
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Charlotte, United States of America
Tech stack
Data analysis
CA Workload Automation Ae
Big Data
Data Architecture
Data Governance
Data Integration
Data Integrity
ETL
Data Visualization
Database Queries
Distributed Data Store
Distributed Systems
Hadoop
Hive
Python
MySQL
Performance Tuning
Cloudera
Software Deployment
Data Streaming
Data Processing
Spark
Pandas
PySpark
Data Pipelines
Job description
As a Cloudera Developer, you will be responsible for developing and maintaining robust, scalable data solutions using the Cloudera platform. This role involves designing and implementing data processing pipelines and ingestion frameworks, primarily using PySpark, while working with cross-functional teams to meet data requirements and deliver actionable business insights., * Design, develop, and maintain data processing pipelines using Cloudera technologies such as Apache Hadoop, Apache Spark, Apache Hive, and Python
- Utilize multiple architectural components in the design and development of client requirements
- Maintain, improve, clean, and manipulate data for operational and analytical data systems
- Develop and maintain data ingestion frameworks for efficiently extracting, transforming, and loading data from various sources
- Collaborate with data engineers and data scientists to understand data requirements and translate them into technical specifications
- Optimize and tune data processing jobs to ensure high performance and scalability
- Implement data governance and security policies to ensure data integrity and compliance
- Monitor and troubleshoot data processing jobs to identify and resolve issues in a timely manner
- Document technical specifications, data flows, and data architecture diagrams
- Adhere to team delivery/release process and cadence for code deployment and release
Requirements
- 5-7 years of experience with distributed data/computing tools such as Hadoop, Hive, MySQL, etc.
- Strong problem-solving skills with an emphasis on product development
- Experience working with and creating data architectures
- Proficient in Python programming for data processing, automation, and analytical solutions
- Experience using PySpark for large-scale data processing and distributed computing environments
- Strong SQL skills with experience developing complex queries, joins, aggregations, and performance optimization
- Knowledge of ETL processes, data integration, and data quality best practices
- Experience using pandas to cleanse, transform, and analyze large datasets
- Experience working with AutoSys
- Ability to analyze data, identify trends and anomalies, and deliver actionable business insights
- Experience creating clear and effective data visualizations and dashboards
- Excellent written and verbal communication skills for coordinating across teams
About the company
Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.
For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:
* Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
* The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
* Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
* Behavioral Health Platform
* Medical, Dental, Vision
* Health Savings Account
* Voluntary Hospital Indemnity (Critical Illness & Accident), For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all our available career opportunities, please visit us at our website.